[SOLVED] Gallery 2 import stalls

GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Wed, 2010-10-13 13:08

I recently installed Gallery 3 and decided to migrate over my Gallery 2 albums and photos. I installed the Gallery 2 import module and pointed it to my Gallery 2 installation. It then began working. Later I noticed that it had stalled out on photo 604 out of 1300 or so. After letting it sit for over an hour with nothing happening, I hit the "Pause" button and then had it restart ("Begin import!").

Now nothing happens. The "Rebuilding images" progress bar appears on the screen, but it never progresses beyond "Starting up...", even when I let it sit for hours.

Also, those 604 images did import, and I received the following message across the top of my screen: "604 of your photos are out of date. Click here to fix them". I did so, and it began processing them (I think it's tweaking the thumbnail sizes). It reached 600 out of 604 and then stopped, just like above. After letting it sit for over an hour, I again paused and tried to resume. Like above, now it just hangs at "Starting up...", and according to the system, all 604 still need to be processed.

Is there any way of "resetting" this import? I'd really like to get Gallery 2 moved over, but I feel like I'm stuck. Any help would be appreciated.

 
Cluster5020

Joined: 2010-05-08
Posts: 35
Posted: Wed, 2010-10-13 13:14

I had this problem too, after I reactivated the tags-modul it loaded again, but without the active tags-modul, it always got hung up on "Starting up..."

Maybe u have the same problem.

greetings

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Wed, 2010-10-13 13:34

Sorry, I'm pretty new to this stuff. Exactly what should I do?

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Wed, 2010-10-13 14:17

Okay, I think I know what you're saying. The Tag module was already enabled, so I disabled it and then tried to import the old galleries. It did not work (same issues as before). I then re-enabled Tag and tried yet again--same problems.

Any other ideas? Gallery 3 works, but I just can't transfer over my Gallery 2 information.

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Wed, 2010-10-13 15:46

More information:

I am running Gallery 2.3.1 and Gallery 3.0 (I never used beta builds--it's a fresh, 3.0 installation).

The maintenance log for trying to import the old information is the following (regardless of whether I let it run for 5 minutes or 5 hours):

Task Import from Gallery 2 started (task id 25)
Group 'Admin' does not exist in Gallery 3, skipping
User with id: 5 already imported, skipping
User with id: 6 already imported, skipping

I don't know what any of that means, though. I would really appreciate some help. It seems silly that I'm stuck with a functioning copy of Gallery 3, but I can't remove my complete dependence on Gallery 2.

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Wed, 2010-10-13 19:26

I've read through the other posts that seem to address this issue (going back about two weeks) and none of their suggestions have helped. Then again, it looks like I'm just running into a common error of some sort. It's kind of a deal-breaker for me; I'm about to just uninstall Gallery 3 and be done with it.

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Thu, 2010-10-14 12:20

So, 24 hours and no help? Time to delete Gallery 3, I guess. It's useless if I still have to hold on to Gallery 2.

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Thu, 2010-10-14 16:04

Could deleting Gallery 3 entirely (along with the corresponding database) and then reinstalling it from scratch fix this issue?

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Fri, 2010-10-15 12:26

Just so that I can put this to rest in my own mind, am I not getting answers because there are no answers to be had, because this is a known problem that's being worked on, or for some other reason?

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Mon, 2010-10-18 13:20

Five days and no help. Oh, well.

 
nivekiam
nivekiam's picture

Joined: 2002-12-10
Posts: 16504
Posted: Mon, 2010-10-18 15:30

<made this comment so much frickin' nicer than originally was>
Unless you're working 80-100 hours per week, have 2-3 hours of commuting each day, and a bunch of personal problems going on in your life, just have patience. All support and development of Gallery is 100% volunteer. Right now support is primarily landing on 2 guys. I don't know what's going on in Dave's life, I know he's a busy guy, but I have an absolute mountain of stuff on my plate.
<end of commentary>

Yes it does look like there are a fair number of people having issues with importing, it would have been great if there were more people testing the betas and release candidates because nearly every time there was an issue Bharat popped in there to figure out what it was and get it working to make that process more robust.

If you still have G3 installed, post what's in your var/logs directory to see if that gives any clue.

Also, for now, please create a ticket here: http://sourceforge.net/apps/trac/gallery (registration is free). Once logged in you can click on New Ticket

That way the issue is logged in the tracking system and once Bharat has time on his plate he'll be able to dig into it a bit more. It could be a number of issues. Server setup, etc.

Since you just state that you found posts and did what was suggested...

Did you try disabling as many plugins as possible in both G2 and G3? Tags, Comments, EXIF, etc?

What graphics toolkit in G3 are you using? (Admin > Settings > Graphics)

What theme in G3 are you using?
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Mon, 2010-10-18 16:07

I have seven (7) log files, labeled 10-12-2010 through 10-18-2010, in my var\logs folder. Each of the files contains only the following: "<?php defined('SYSPATH') or die('No direct script access.'); ?>"

I did attempt disabling and re-enabling mods in both G2 and G3. I noted that the G3 mod Tags seems to be required for an import to work (there are a number of other threads here about this), but it was enabled by default anyway.

I am using GD version bundled (2.0.34 compatible) (the G3 default, I believe) and my theme is Gallery Wind for both the gallery and my admin panel (also the G3 default, I think).

I will also create a ticket. Other than just describing the error, is there anything specific that I should include that Bharat would find useful?

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Mon, 2010-10-18 20:35

Also, I tried setting up a Sourceforge account to log a ticket, but the SF site keeps timing out for me. I know you have no control over that, but I figured I'd let you know why I haven't submitted the ticket as per your instructions.

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Tue, 2010-10-26 02:59

I'm suspicious that GD is blowing your memory limit. What's in your apache2 log files in /var/logs? Check for PHP errors there. Failing that, can you pm me an admin user/pass on your G3 so that I can try the import from here? I'll snoop the tcp traffic to see if there's an error getting sent back that we're not noticing.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Thu, 2010-10-28 13:26

I'm sorry that it took me so long to get back to you; I've been away from the computer for a week. The log files in /var/logs are all named "2010-10-XX.log.php" (where XX is the day). All of them are 65 bytes and contain the following:

<?php defined('SYSPATH') or die('No direct script access.'); ?>

Does that mean anything to you? If not, let me know and I'll try to figure out the PM system to toss you the admin login info for my G3 install. I do appreciate the help, despite my earlier rudeness.

 
nivekiam
nivekiam's picture

Joined: 2002-12-10
Posts: 16504
Posted: Thu, 2010-10-28 13:47

For sending a PM, just click on "Write to author" under bharat's post and you'll send him a message.
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Thu, 2010-10-28 15:55

Thanks, nivekiam. If I don't hear otherwise from bharat in the next few hours (perhaps that php code solves the mystery for him), I'll toss him my login details.

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Thu, 2010-10-28 18:15

PM sent to bharat. I really hope he can figure this out. Thanks.

 
bryan145

Joined: 2010-10-24
Posts: 83
Posted: Fri, 2010-10-29 13:51

I am having the same issues with importing my personal Gallery 2 to 3, which contains over 3,000 photos. I am posting to this thread so I will be subscribed to it. Thanks.

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Fri, 2010-10-29 13:55

bryan145, I've sent bharat the login information for my G3 installation. If he's able to fix things for me, I'll pass along the solution to you here as well.

 
danielneto
danielneto's picture

Joined: 2005-09-21
Posts: 7
Posted: Fri, 2010-10-29 14:30

I have the same issue importing my G2 to G3, which contains 1800+ photos: disabled modules in both G2 and G3 and stalled installation.

 
bryan145

Joined: 2010-10-24
Posts: 83
Posted: Fri, 2010-10-29 15:36

Here's something I have found that nobody else has mentioned. With as many modules deactivated as possible (tags module IS activated at this point), the import actually starts, but it immediately halts and complains of duplicate tag entries. How can the tags feature work unless you have the same tag value in multiple albums? Is this something that was overlooked? I tried the import again with tags disabled and it just sits there with "Starting up..." in the progress window. It doesn't even add anything to today's log file as to why it locked up. I don't think I have eAccelerator and XCache PHP performance extensions because when I tried to disable them, as suggested per the Notes section, I got an "invalid php command" error.

 
bryan145

Joined: 2010-10-24
Posts: 83
Posted: Fri, 2010-10-29 15:48

Also, I successfully imported another Gallery 2 to Gallery 3 with no problems or glitches at all. The only difference with the successful import and my personal gallery is the presence of tags. The successful import had no existing tags at all anywhere. My personal gallery still stuck in G2 has tags EVERYWHERE lol!

 
bryan145

Joined: 2010-10-24
Posts: 83
Posted: Fri, 2010-10-29 16:20

I figured out the tags issue (I think LOL)! I used an ampersand character "&" in the keyword field of a few of my G2 albums, as in the keyword "AT&T". Gallery 2 had no issues with the ampersand but it appears Gallery 3 does. Look carefully at the below example:

Keywords as entered in Gallery 2 on a particular album:
AT&T, BellSouth, AOC, CIAC, Hwy 280, Sandra Woodruff, Jack Key, Ken Johnson, Martha Dobbins, Albert Beck, Bryan Glenn, Barry Crump, Mike McGraw, Brandon Johnson, Tijuana Jones

Error message from import to Gallery 3:
#1062: Duplicate entry 'T, BellSouth, AOC, CIAC, Hwy 280, Sandra Woodruff, Jack Key, Ken' for key 2 [ INSERT INTO `tags` (`name`, `count`) VALUES ('T, BellSouth, AOC, CIAC, Hwy 280, Sandra Woodruff, Jack Key, Ken Johnson, Martha Dobbins, Albert Beck, Brya

The error message says the beginning of the duplicate entry starts with T, which is the letter right after the ampersand character in the keyword field in G2.

I don't know if this is an actual problem, or "THE" problem everyone is having, but I thought it was awfully suspicious looking to me.

 
nivekiam
nivekiam's picture

Joined: 2002-12-10
Posts: 16504
Posted: Fri, 2010-10-29 16:33

Please search to see if a ticket hasn't been filed for this already and if you can't find one, file one:
http://sourceforge.net/apps/trac/gallery/
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Fri, 2010-10-29 17:56

bryan145, none of my Gallery 2 images are tagged at all. In fact, according to the Gallery 2 import screen:

Your Gallery 2 has the following importable data in it:
2 users, 3 groups, 18 albums, 1374 photos, 0 movies, 0 comments, 0 tagged photos/movies/albums

 
bryan145

Joined: 2010-10-24
Posts: 83
Posted: Fri, 2010-10-29 18:04

Hmmm.......could it be the number of photos or overall size of the G2 that's being imported?

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Fri, 2010-10-29 18:59

Well, bharat had some ideas about memory limits (I don't know the details). He has my admin password, so hopefully when he has the chance he can log in and tinker to find out more.

 
bryan145

Joined: 2010-10-24
Posts: 83
Posted: Fri, 2010-10-29 21:11

Hey everyone, I successfully imported another G2 to G3 WITH keywords and tags (without ampersands), and the stats were 31 albums and 2031 photos. I used all the default settings during the import. It took about a couple of hours to complete.

I am confident that once I remove all the ampersands from my personal gallery, I will be able to import it as well. I will keep you posted!

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Fri, 2010-10-29 21:50

Let us know what happens. I'm virtually certain that my G2 installation has no ampersands at all (no tags, and I don't think that even file names or photo titles use the character).

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Sat, 2010-10-30 04:15

@GuJiaXian: your import is failing with a 500 error on the server side. There should be some indication about what's going wrong in your Apache2 error logs (generally in /var/logs/apache2, but on shared hosting you may have to talk to your sysadmin). I'm guessing that this is a memory limit issue with GD and I suggest that you talk to your host provider about getting you access to ImageMagick which is installed on your system but is not in the open_basedir restriction provided.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git

 
bryan145

Joined: 2010-10-24
Posts: 83
Posted: Mon, 2010-11-01 04:04

I removed all the ampersands from my G2 and it successfully imported to G3. It stalled a coulple of times but I was able to restart it without any problems at all.

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Mon, 2010-11-01 11:46
bharat wrote:
@GuJiaXian: your import is failing with a 500 error on the server side. There should be some indication about what's going wrong in your Apache2 error logs (generally in /var/logs/apache2, but on shared hosting you may have to talk to your sysadmin). I'm guessing that this is a memory limit issue with GD and I suggest that you talk to your host provider about getting you access to ImageMagick which is installed on your system but is not in the open_basedir restriction provided.

I appreciate you looking into this. To be honest, I have no idea where to find either ImageMagick (I checked my website's "cpanel" and don't see it there) or where to find my Apache logs (I logged into my site via an ftp client, went up to the /.. level where all the system stuff is, and poked around but found nothing log-related). If I call up my webhosting service, exactly what do I need to ask them to do?

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Thu, 2010-11-04 03:53

Ask your web host where ImageMagick lives, then ask them if it's in your open_basedir restriction, and if it's not, ask them to relax your open_basedir restriction so that you can get access to it.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Thu, 2010-11-04 11:29

Okay, I will do so, and I'll report back once they respond. Thanks!

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Thu, 2010-11-04 14:25

bharat, my host opened access to ImageMagick and said that the path to ImageMagick on the server is /usr/bin/convert. What should I do next?

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Sun, 2010-11-07 05:49

@GuJiaXian if it's available, then you should be able to go to Admin > Settings > Graphics and choose ImageMagick there. If you can't, can you provide a screenshot of what you see?
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Sun, 2010-11-07 13:11

ImageMagick was, in fact, there. I activated it and tried the import again. It seems to be working...it's currently processing through the queue (farther than it's ever gotten before). I'll post when it finishes to confirm that it ultimately worked. Perhaps you can post this as a solution (activating ImageMagick) in a FAQ somewhere, or perhaps as a sticky.

Thanks again for helping me with this. I do appreciate it.

 
GuJiaXian

Joined: 2010-10-13
Posts: 32
Posted: Sun, 2010-11-07 15:08

I can confirm that the import worked. Thanks!