Your search index needs to be updated. Fix this now

adblunt

Joined: 2009-01-15
Posts: 13

Posted: Mon, 2009-07-27 15:53

Hi there

I've recently installed gallery3 (now running beta 2) and imported everything from my gallery2 installation. I read that the process could be sped up somewhat by turning off the search and exif data modules which i did and now that my import is complete, it's asking me to update the remaining search and exif data.
When i try to update it sits on '0 records updated, index is 61% up-to-date' and the progress bar doesn't move, i've left this running several times for over an hour and no chance. I have checked /var/logs and no log has been created today while i've been testing.
The same thing happens when i attempt to update the exif data.

Any help on this would be much appreciated.

Thanks,
Andy

bharat

Joined: 2002-05-21
Posts: 7934

Posted: Thu, 2009-07-30 21:40

What's in your gallery3/var/logs error logs? Anything interesting in there?
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

adblunt

Joined: 2009-01-15
Posts: 13

Posted: Fri, 2009-07-31 10:15

Ok i've restarted apache and mysql and logged back in to gallery and then clicked on fix the search index and here's the complete log:

<?php defined('SYSPATH') or die('No direct script access.'); ?>

2009-07-30 22:50:17 +01:00 --- error: Uncaught Exception: @todo FORBIDDEN in file modules/gallery/helpers/access.php on line 176
2009-07-30 22:53:18 +01:00 --- error: Uncaught Kohana_Database_Exception: There was an SQL error: - SHOW TABLES FROM `gallery3` in file system/libraries/drivers/Database/Mysqli.php on line 142
2009-07-30 22:53:18 +01:00 --- error: Uncaught Kohana_Database_Exception: There was an SQL error: - SHOW TABLES FROM `gallery3` in file system/libraries/drivers/Database/Mysqli.php on line 142
2009-07-30 22:53:18 +01:00 --- error: Uncaught Kohana_Database_Exception: There was an SQL error: - SHOW TABLES FROM `gallery3` in file system/libraries/drivers/Database/Mysqli.php on line 142
2009-07-30 22:53:18 +01:00 --- error: Uncaught Kohana_Database_Exception: There was an SQL error: - SHOW TABLES FROM `gallery3` in file system/libraries/drivers/Database/Mysqli.php on line 142

bharat

Joined: 2002-05-21
Posts: 7934

Posted: Fri, 2009-07-31 20:04

Those "SHOW TABLES FROM" mysql errors are curious. Is "gallery3" the name of your database? Are those recent errors? Try using wireshark/ethereal/tcpflow/tcpdump to watch the HTTP traffic when you run the update task.. do you see any weird HTML errors come back?
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

adblunt

Joined: 2009-01-15
Posts: 13

Posted: Tue, 2009-08-04 18:49

gallery3 is the name of my database.

i've run tcpdump a couple of times now and gone through what it's logged and i can't see anything that looks like an error or even anything useful the only odd thing i did come across was a few of the log files were encoded, i'm assuming they may just be jpgs.

might it have anything to do with having over 80,000 files in my gallery?

bharat

Joined: 2002-05-21
Posts: 7934

Posted: Wed, 2009-08-05 02:09

Can you run mysqlcheck on your gallery3 database to see if there are any database issues? Can you record your tcpdump output so that we can see the HTTP stream here?
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

adblunt

Joined: 2009-01-15
Posts: 13

Posted: Tue, 2009-08-11 20:04

i've run a mysqlcheck and all tables come back OK. i've had a go with both tcpdump and tcpflow and both seem to come out with quite different outputs, so i don't know if it's me doing it wrong or not. here's what i've got after letting them run a couple of minutes beginning just as i click the 'Fix this now' link at the top of the gallery.

http://www.andysroms.com/hosted/gallery/tcpdump.txt

http://www.andysroms.com/hosted/gallery/tcpflow.txt

bharat

Joined: 2002-05-21
Posts: 7934

Posted: Thu, 2009-08-13 18:47

The tcpdump info doesn't seem to include the payload, and the tcpflow output seems to be in some kind of weird binary format which I can't easily decipher. Can you try getting the latest code (see the link below) and if that doesn't fix it, can you provide me with an admin account on your G3 so that I can try triggering the task from here?
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

adblunt

Joined: 2009-01-15
Posts: 13

Posted: Fri, 2009-08-14 17:59

i've updated to the latest experimental version and still no luck PMing with account details

bharat

Joined: 2002-05-21
Posts: 7934

Posted: Tue, 2009-08-25 20:47

Sorry for the long silence. As I mentioned in my PM, I'm not seeing anything out of the ordinary in the server responses, except that it's not actually making progress towards indexing everything. This looks like a bug in the code to me, but I can't tell more without getting in there and tweaking the code (or having somebody else do it). If you can give me FTP or SSH access I can probably sort this out.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

bharat

Joined: 2002-05-21
Posts: 7934

Posted: Sun, 2009-08-30 20:33

Thanks for sharing your details with me, adblunt. I've found and fixed the problem (documented in http://sourceforge.net/apps/trac/gallery/ticket/693). I processed another ~20% of your search just to make sure that it'll work, but I left the rest for you. It's not *fast* at processing these records, but it'll get done.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

adblunt

Joined: 2009-01-15
Posts: 13

Posted: Sun, 2009-08-30 20:46

thanks a lot, really appreciated

bls0n

Joined: 2009-10-19
Posts: 1

Posted: Mon, 2009-10-19 01:33

Deleted comment.

adblunt Joined: 2009-01-15 Posts: 13	Posted: Mon, 2009-07-27 15:53
	Hi there I've recently installed gallery3 (now running beta 2) and imported everything from my gallery2 installation. I read that the process could be sped up somewhat by turning off the search and exif data modules which i did and now that my import is complete, it's asking me to update the remaining search and exif data. When i try to update it sits on '0 records updated, index is 61% up-to-date' and the progress bar doesn't move, i've left this running several times for over an hour and no chance. I have checked /var/logs and no log has been created today while i've been testing. The same thing happens when i attempt to update the exif data. Any help on this would be much appreciated. Thanks, Andy
	XUser login Username: * Password: * Create new account Request new password
bharat Joined: 2002-05-21 Posts: 7934	Posted: Thu, 2009-07-30 21:40
	What's in your gallery3/var/logs error logs? Anything interesting in there? --- Problems? Check gallery3/var/logs bugs/feature req's \| upgrade to the latest code \| use git \| help! vote!

adblunt Joined: 2009-01-15 Posts: 13	Posted: Fri, 2009-07-31 10:15
	Ok i've restarted apache and mysql and logged back in to gallery and then clicked on fix the search index and here's the complete log: <?php defined('SYSPATH') or die('No direct script access.'); ?> 2009-07-30 22:50:17 +01:00 --- error: Uncaught Exception: @todo FORBIDDEN in file modules/gallery/helpers/access.php on line 176 2009-07-30 22:53:18 +01:00 --- error: Uncaught Kohana_Database_Exception: There was an SQL error: - SHOW TABLES FROM `gallery3` in file system/libraries/drivers/Database/Mysqli.php on line 142 2009-07-30 22:53:18 +01:00 --- error: Uncaught Kohana_Database_Exception: There was an SQL error: - SHOW TABLES FROM `gallery3` in file system/libraries/drivers/Database/Mysqli.php on line 142 2009-07-30 22:53:18 +01:00 --- error: Uncaught Kohana_Database_Exception: There was an SQL error: - SHOW TABLES FROM `gallery3` in file system/libraries/drivers/Database/Mysqli.php on line 142 2009-07-30 22:53:18 +01:00 --- error: Uncaught Kohana_Database_Exception: There was an SQL error: - SHOW TABLES FROM `gallery3` in file system/libraries/drivers/Database/Mysqli.php on line 142

bharat Joined: 2002-05-21 Posts: 7934	Posted: Fri, 2009-07-31 20:04
	Those "SHOW TABLES FROM" mysql errors are curious. Is "gallery3" the name of your database? Are those recent errors? Try using wireshark/ethereal/tcpflow/tcpdump to watch the HTTP traffic when you run the update task.. do you see any weird HTML errors come back? --- Problems? Check gallery3/var/logs bugs/feature req's \| upgrade to the latest code \| use git \| help! vote!

adblunt Joined: 2009-01-15 Posts: 13	Posted: Tue, 2009-08-04 18:49
	gallery3 is the name of my database. i've run tcpdump a couple of times now and gone through what it's logged and i can't see anything that looks like an error or even anything useful the only odd thing i did come across was a few of the log files were encoded, i'm assuming they may just be jpgs. might it have anything to do with having over 80,000 files in my gallery?

bharat Joined: 2002-05-21 Posts: 7934	Posted: Wed, 2009-08-05 02:09
	Can you run mysqlcheck on your gallery3 database to see if there are any database issues? Can you record your tcpdump output so that we can see the HTTP stream here? --- Problems? Check gallery3/var/logs bugs/feature req's \| upgrade to the latest code \| use git \| help! vote!

adblunt Joined: 2009-01-15 Posts: 13	Posted: Tue, 2009-08-11 20:04
	i've run a mysqlcheck and all tables come back OK. i've had a go with both tcpdump and tcpflow and both seem to come out with quite different outputs, so i don't know if it's me doing it wrong or not. here's what i've got after letting them run a couple of minutes beginning just as i click the 'Fix this now' link at the top of the gallery. http://www.andysroms.com/hosted/gallery/tcpdump.txt http://www.andysroms.com/hosted/gallery/tcpflow.txt

bharat Joined: 2002-05-21 Posts: 7934	Posted: Thu, 2009-08-13 18:47
	The tcpdump info doesn't seem to include the payload, and the tcpflow output seems to be in some kind of weird binary format which I can't easily decipher. Can you try getting the latest code (see the link below) and if that doesn't fix it, can you provide me with an admin account on your G3 so that I can try triggering the task from here? --- Problems? Check gallery3/var/logs bugs/feature req's \| upgrade to the latest code \| use git \| help! vote!

adblunt Joined: 2009-01-15 Posts: 13	Posted: Fri, 2009-08-14 17:59
	i've updated to the latest experimental version and still no luck PMing with account details

bharat Joined: 2002-05-21 Posts: 7934	Posted: Tue, 2009-08-25 20:47
	Sorry for the long silence. As I mentioned in my PM, I'm not seeing anything out of the ordinary in the server responses, except that it's not actually making progress towards indexing everything. This looks like a bug in the code to me, but I can't tell more without getting in there and tweaking the code (or having somebody else do it). If you can give me FTP or SSH access I can probably sort this out. --- Problems? Check gallery3/var/logs bugs/feature req's \| upgrade to the latest code \| use git \| help! vote!

bharat Joined: 2002-05-21 Posts: 7934	Posted: Sun, 2009-08-30 20:33
	Thanks for sharing your details with me, adblunt. I've found and fixed the problem (documented in http://sourceforge.net/apps/trac/gallery/ticket/693). I processed another ~20% of your search just to make sure that it'll work, but I left the rest for you. It's not fast at processing these records, but it'll get done. --- Problems? Check gallery3/var/logs bugs/feature req's \| upgrade to the latest code \| use git \| help! vote!

adblunt Joined: 2009-01-15 Posts: 13	Posted: Sun, 2009-08-30 20:46
	thanks a lot, really appreciated

bls0n Joined: 2009-10-19 Posts: 1	Posted: Mon, 2009-10-19 01:33
	Deleted comment.

Your search index needs to be updated. Fix this now

XUser login