Recreating specific thumbnails and resizes

griffinmt
griffinmt's picture

Joined: 2009-09-06
Posts: 128
Posted: Wed, 2009-09-23 19:39

Can anyone recommend a reasonable way to recreate thumbnail and resize files.

During a 1600 picture load and subsequent bulk movements to other albums, a number of the pictures don't show up, just the filename, in the thumbnail view and resize view. Since the database had the correct entries, I just directly copied over the missing fullsize files into the correct album folder, hoping to 'con' it into getting fixed when I ran the Rescue module. No joy.

Are the 'Dirty' indicators in the database the best way to do this??

Martyn T. Griffin

 
nivekiam
nivekiam's picture

Joined: 2002-12-10
Posts: 16503
Posted: Wed, 2009-09-23 19:43
Quote:
Are the 'Dirty' indicators in the database the best way to do this??

Right now I believe so.
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here

 
griffinmt
griffinmt's picture

Joined: 2009-09-06
Posts: 128
Posted: Wed, 2009-09-23 20:06

Before making any change, I went to the Maintenance panel and noticed that I had 7 out of date photos that needed rebuilding. So I figured I would get these done and out of the way so as not to complicate matters later while testing.

I clicked the Run button and the screen grayed and popped up the alert that it was starting, but nothing happened for about 10 minutes, so I clicked the Pause button.

On the list of Maintenance tasks, there were TWO entries with a Status of Stalled. I clicked the first one to Resume, but it did not seem to make any progress, so I clicked the Pause button again.

An additional Stall indicator did NOT appear, just the original two. So I cancelled them both and for the resulting Finished Tasks, I looked at the log for it as follows:

Quote:
Task Rebuild Images started (task id 30)
Task Rebuild Images resumed (task id 30)
Task Rebuild Images resumed (task id 30)

Note that it seems to be spawning off two attempts to run the task. I wonder if this is creating some form of interlock with a file or database row?

The previous rebuild attempts are on hold for now!

Martyn T. Griffin

 
floridave
floridave's picture

Joined: 2003-12-22
Posts: 22888
Posted: Thu, 2009-09-24 03:18

Could be an issue with the images. There has been some improvements to the EXIF module in the last few days.
Try and experimental version and post the full-sized image that is appears to be the issue.

Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team

 
griffinmt
griffinmt's picture

Joined: 2009-09-06
Posts: 128
Posted: Sat, 2009-09-26 00:17

I think there is more going on than meets the eye.
I copied off all of my /albums in the var folder - just over 12000 fullsize pictures.
Then I reorganized then all under a single Gallery folder and several subfolders etc.
I gutted my installation (and database), reinstalled G3B3 and the latest exp version.
Then I added my new Gallery folder as a valid source for the Server Add function and fired
it up. It as about 3500 pictures strong and has been running about 9 hours.

But using another browser, I looked at it and it all seems nice and neat except that one of the subfolders is
now located under the wrong top folder/album. During all this time I had been using the
system to re-organize the albums that had already been completed, marking them to show by date captured etc.
My guess is that some small conflict occurred and was mishandled, causing the subfolder/album to get inserted
into the wrong top folder.

Martyn T. Griffin

 
floridave
floridave's picture

Joined: 2003-12-22
Posts: 22888
Posted: Sat, 2009-09-26 04:25

So you have 2 different issues now? A bit confusing for me now.

Quote:
and post the full-sized image that is appears to be the issue.

Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team

 
griffinmt
griffinmt's picture

Joined: 2009-09-06
Posts: 128
Posted: Sat, 2009-09-26 16:38

That mass load I started yesterday STALLED sometime during the night at just under 8000 added. Tried to pause and resume it but with no luck. Managed to track the last picture dowm - It had three thumbnails shown in the album with NO picture image. I deleted all three and tried resume again with no luck. Went into the items table and found the last entry added (still had thumb and resize dirty flags set). I deleted that entry, removed the source picture and this time the Add picked up and started running again.

Attached is the 'problem' picture - be aware it is about 2.4MB in size and is 6015px wide by 8569px high with 1200 dpi resolution.

OOPS - max upload size is 1mb - what next without risking changing the contents.

(Edit) Just tried to upload that picture via web. Attached is the result - a bad format error that made it fail, but also the net result is a database entry for it that shows up as an empty thumbnail.

Martyn T. Griffin

AttachmentSize
uploaderror.jpg9.38 KB
uploadblank.jpg10.83 KB
 
floridave
floridave's picture

Joined: 2003-12-22
Posts: 22888
Posted: Sat, 2009-09-26 17:42
Quote:
OOPS - max upload size is 1mb - what next without risking changing the contents.

See if you can use: http://fastfreefilehosting.com/ to upload the image, then post a link to it. Or use your server/host and just post a link to the image.

Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team

 
griffinmt
griffinmt's picture

Joined: 2009-09-06
Posts: 128
Posted: Sat, 2009-09-26 22:21

Dave,

Get picture at xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

Valid for the next 24 hrs

Martyn T. Griffin

 
floridave
floridave's picture

Joined: 2003-12-22
Posts: 22888
Posted: Sat, 2009-09-26 19:35

The connection has timed out

Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team

 
griffinmt
griffinmt's picture

Joined: 2009-09-06
Posts: 128
Posted: Sat, 2009-09-26 22:20

Ok, try the following site.

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

Martyn T. Griffin

 
floridave
floridave's picture

Joined: 2003-12-22
Posts: 22888
Posted: Sat, 2009-09-26 20:09
Quote:
You don't have permission to access /Jayse-Sept0003.JPG on this server.

Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team

 
griffinmt
griffinmt's picture

Joined: 2009-09-06
Posts: 128
Posted: Sat, 2009-09-26 20:21

Try it again. I forgot to disable the hotlinking block.
Martyn T. Griffin

 
floridave
floridave's picture

Joined: 2003-12-22
Posts: 22888
Posted: Sun, 2009-09-27 22:44

OK I finally got your image.
Can you tell me the steps you have taken in changing this image from when you got it from the camera?

Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team

 
griffinmt
griffinmt's picture

Joined: 2009-09-06
Posts: 128
Posted: Mon, 2009-09-28 22:51

Dave,

It did not come directly from a camera - it was scanned in and then I used Exifer to set the dates/time and thumbnail into it. I have done this for all my old pictures without problem.

But this one was much higher resolution at 1200dpi and I think that this is the major cause of the failure when loading it. In fact, I did the same thing over but scanned it at about 300dpi, added the stuff with Exifer, and was able to load it in without problem.

If you have a way to reduce resolution without destroying the exif data, try it at 1000dpi, 800dpi, 600dpi and 400dpi to see roughly where the failure stops. It may just be a 'memory' problem.

Martyn T. Griffin

 
floridave
floridave's picture

Joined: 2003-12-22
Posts: 22888
Posted: Tue, 2009-09-29 05:00
Quote:
I have done this for all my old pictures without problem.

What about all the others?

Quote:
But this one was much higher resolution at 1200dpi

Oh OK.
What if yopu don't change the EXIF info? We use a 3rd party EXIF library and it might have some issues with this case.

Quote:
If you have a way to reduce resolution without destroying the exif data, try it at 1000dpi, 800dpi, 600dpi and 400dpi to see roughly where the failure stops. It may just be a 'memory' problem.

I was able to 'crop' the image in photoshop and still reproduce the issue. I will create a ticket for this but don't hold your breath with a workaround being in place ( lower resolution scan ).
Feel free to do more testing to narrow down the issue.

Dave

_____________________________________________
Blog & G2 || floridave - Gallery Team