G1 > G2 import problem..orange bar stops, NO ERRORS reported

kspades

Joined: 2004-01-29
Posts: 16
Posted: Wed, 2005-08-24 23:06

Hey Folks, afer years and years of sucess with the gallery product (every beta, every bugfixed, everything) I've finally ran into a snag.

Im running Gallery2 and trying to do an import from my Gallery1 albums. The Orange import bar never completes on most albums. So far I've ran thu all the pre-g2 prep steps (from gallery1 maint page) and they all came back good. I've disabled GD,EXIF and ModRewrite in G2 and it still does not work. According to the install check pages there is 40MB of memory available to PHP on this box can somebody advise me where Im going wrong or what esle I could try.

Also, is there another way I can move these albums to G2 w/o the import utility? See, Im doing these albums 1 at a time and its failing, there are 104 albums on my site and I dare not select em all for mass import.

HELP

----

Gallery version = 2.0-rc-2 core 0.9.36
PHP version = 4.3.10 cgi
Webserver = Apache/1.3.33 (Unix)
Database = mysqlt 4.0.25-standard-log
Toolkits = ArchiveUpload, NetPBM
Operating system = Linux infong 2.4 #1 SMP Mon Aug 9 10:21:08 CEST 2004 i686 unknown
Browser = Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.10) Gecko/20050725 Firefox/1.0.6 (Ubuntu package 1.0.6)

 
mindless
mindless's picture

Joined: 2004-01-04
Posts: 8601
Posted: Thu, 2005-08-25 01:41

can you try an import of one small album with logged debug mode turned on in config.php and post a link to the log file here?

 
jmullan
jmullan's picture

Joined: 2002-07-28
Posts: 974
Posted: Thu, 2005-08-25 14:53

What does the memory usage in the upper right hand corner say? Are you getting any error messages in your apache error logs?

 
kspades

Joined: 2004-01-29
Posts: 16
Posted: Fri, 2005-08-26 13:23
jmullan wrote:
What does the memory usage in the upper right hand corner say? Are you getting any error messages in your apache error logs?

I dont really have access to my apache logs and the top bar reads 40mb available memory. Im tryign to work though enabling the logs in the config.php but unless its me ALL the other options work (buffering, etc) except the one that writes out a log...not having a fun time with this at all.

 
dmz001

Joined: 2005-08-16
Posts: 13
Posted: Fri, 2005-08-26 15:17

I have a similar issue. I've uploaded gallery2 rc2 to my ISP and importing images from a local directory hangs. All the files appear to have ended up in the correct location but the thumbnails and resized images are broken.

I tried the maintainence rebuild all, but that hangs at some point, and trying it again runs through but ends up with errors, and the thumbnails and resized images are still broken.

I think it's my ISP killing the php process before it completes. That leaves things in a strange state.

Is there something that can resync the database and the filesystem? What about doing the rebuild from the command line? Anything?

 
kspades

Joined: 2004-01-29
Posts: 16
Posted: Fri, 2005-08-26 15:53

Here is my logfile from a failed upload. This log is from the moment I hit import (from the confirmation screen) to the moment it stopped. I dont see anything that would suggest a problem, but please review it maybe the expets know what to look for.

http://www.vellypooh.com/g2/log.txt

The top of my screen reads: Memory used: 11349224, total: 40M

Thanks

 
jmullan
jmullan's picture

Joined: 2002-07-28
Posts: 974
Posted: Fri, 2005-08-26 16:13

kspades, you have a similar problem in a different part of gallery2.

Can you add one single image by itself correctly?

 
kspades

Joined: 2004-01-29
Posts: 16
Posted: Fri, 2005-08-26 16:26
jmullan wrote:
kspades, you have a similar problem in a different part of gallery2.

Can you add one single image by itself correctly?

Yes, I just ran a test to see if I can upload a single image from my windows machine, it worked sucessfull (though the thumnail did not generate correctly)...I ran the thumnail-regnerator in Maintanace menu but that did not fix the problem, it told me 17 thumbs failed to build (assuming that was one of them). Is this a known problem, or is there a fix available?

Thanks

 
jmullan
jmullan's picture

Joined: 2002-07-28
Posts: 974
Posted: Fri, 2005-08-26 16:52

So, no, you can't add one image by itself correctly. YOu need to fix that problem. Do you have any image processing modules installed and activated? If you have gd enabled, what happens when you disable it?

 
kspades

Joined: 2004-01-29
Posts: 16
Posted: Fri, 2005-08-26 17:15
jmullan wrote:
So, no, you can't add one image by itself correctly. YOu need to fix that problem. Do you have any image processing modules installed and activated? If you have gd enabled, what happens when you disable it?

I disabled the GD module and rebuilt all thumbnails and the ones that were not bing built got rebuilt. I also uploaded another single image and that also worked (and even built the thumb). I tried importing a gallery and that still did not work. here is the new log (from the import confirm screen until the orange bar stopped).

Memory used: 11302496, total: 40M
http://vellypooh.com/g2/log2.txt

 
foobonic

Joined: 2002-09-13
Posts: 34
Posted: Tue, 2005-08-30 18:41

HI all,

im having the exact same problem as described above. im bumping this thread in hopes that someone has found a solution.

thanks.
foobonic.

 
jmullan
jmullan's picture

Joined: 2002-07-28
Posts: 974
Posted: Tue, 2005-08-30 19:38

You are having the exact same problem where you can't add one image at a time?

 
jmullan
jmullan's picture

Joined: 2002-07-28
Posts: 974
Posted: Tue, 2005-08-30 19:40

Also, kspades, does this image exist on your box?
/homepages/35/d93225757/htdocs/g2data/albums/mattars/japan/tokyo/IMG_4725.jpg

 
foobonic

Joined: 2002-09-13
Posts: 34
Posted: Tue, 2005-08-30 20:33
jmullan wrote:
You are having the exact same problem where you can't add one image at a time?

I apologize for being unclear... I ment to say, im having the exact same problem as the orginal thread post by kspades.

Orange progress bar hangs when importing the majority of my albums from G1. Most of the time, it starts importing (i can see the image/sub-album names being imported), and then it just stops/hangs.

When it stops/hangs, the browser status says "Done", the orange bar is about 60% complete. Under the orange bar it reads something like: "Time Remaining: 2 seconds. Continue..." In the upper right hand cornor, the memory stats read "0,0"

I've tried all of the suggestions provided in these and other threads... increased php memory to 120megs, disabled the all image tools (GD, Imagemagick, etc) except NetPBM. I can also add single images with out any problems...

If there is anything else I can provide you with to help isolate and solve this problem please by all means let me know!

Thanks again,
Foobonic.

 
jmullan
jmullan's picture

Joined: 2002-07-28
Posts: 974
Posted: Tue, 2005-08-30 21:34

foobonic, did you disable exif?

 
foobonic

Joined: 2002-09-13
Posts: 34
Posted: Tue, 2005-08-30 22:01
jmullan wrote:
foobonic, did you disable exif?

yes sir.. EXIF/IPTC is off (theres a little red thumbs down icon).

Foobonic.

 
foobonic

Joined: 2002-09-13
Posts: 34
Posted: Wed, 2005-08-31 03:29

I think i figured out what the major malfunction was.... not enough memory. I increase my memory from 200megs to 320megs and everything seems to be working.

It only chokes while creating thumbnails on really deeply nested albums. Maybe ill try 512megs, hehe. I really hope i don't get a phone call from my hosting company =)

Thanks again man!
Foobonic.

 
myn

Joined: 2003-01-23
Posts: 8
Posted: Sat, 2005-09-03 21:05
foobonic wrote:
I think i figured out what the major malfunction was.... not enough memory. I increase my memory from 200megs to 320megs and everything seems to be working.

It only chokes while creating thumbnails on really deeply nested albums. Maybe ill try 512megs, hehe. I really hope i don't get a phone call from my hosting company =)

Thanks again man!
Foobonic.

I too am having the same import errors, having the orange progress bar stop intermitantly. I see from some of the posts that many of the users that are having the problems are using 1and1 (me included).

Since I don't have access to php.ini how did you increase your memory?

 
valiant

Joined: 2003-01-04
Posts: 32509
Posted: Sun, 2005-09-04 02:21

you can also increase the php memory limit with .htaccess, if the host allows it.
see: FAQ Gallery:c.16

 
jmullan
jmullan's picture

Joined: 2002-07-28
Posts: 974
Posted: Tue, 2005-09-06 23:40

Other things that you could try would be to import in batches or to turn of thumbnail generation on upload then rebuild thumbnails after uploading.

 
rasp

Joined: 2005-09-15
Posts: 5
Posted: Thu, 2005-09-15 22:32

I'm having this same problem importing G1->G2.

I'm doing this from a different machine as my actual gallery. I have used rsync to move the albums directory over and have made sure that the files are identical.

I increased the memory to 512M in my php.ini.
I have tried to import in small batches
I have tried turning thumbnail generation off
I have turned on the debugging module, but I don't think the info is helpful but it looks like it fails during locking
so I tried file and database locking.

but it still hangs, and not always on the same file.

This is a fedora 2 x86 machine running XFS filesystem with all other requirements met succesfully.

any ideas?

 
jmullan
jmullan's picture

Joined: 2002-07-28
Posts: 974
Posted: Thu, 2005-09-15 23:47
 
jmullan
jmullan's picture

Joined: 2002-07-28
Posts: 974
Posted: Thu, 2005-09-15 23:48

rasp, open a NEW thread.