Gallery URL = http://www.photosbybailini.com/g2/main.php
Gallery version = 2.3 core 1.3.0
API = Core 7.54, Module 3.9, Theme 2.6, Embed 1.5
PHP version = 4.4.9 cgi
Webserver = Apache
Database = mysqlt 5.0.83-log, lock.system=database
Toolkits = ArchiveUpload, Exif, Getid3, LinkItemToolkit, NetPBM, Thumbnail, SquareThumb, ImageMagick
Acceleration = partial/3600, partial/3600
Operating system = Linux cgi0701.int.bizland.net 2.6.34.4-nx #1 SMP Tue Aug 24 21:13:13 EDT 2010 i686
Default theme = carbon
gettext = enabled
Locale = en_GB
Browser = Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_5_8; en-us) AppleWebKit/533.17.8 (KHTML, like Gecko) Version/5.0.1 Safari/533.17.8
Rows in GalleryAccessMap table = 1079
Rows in GalleryAccessSubscriberMap table = 77293
Rows in GalleryUser table = 221
Rows in GalleryItem table = 77290
Rows in GalleryAlbumItem table = 2697
Rows in GalleryCacheMap table = 173283
Hello,
I have had Gallery 2 installed for two years without any major problems. A couple of months ago, I started getting database errors. The techs at my hosting company, Powweb, said some items were corrupted and were able to fix it. Then, a couple of weeks ago I started getting ERROR_LOCK_TIMEOUT. Switching from File to Database Locking seemed to fix it. Recently, I've started getting a blank page when accessing random pages. For example, when I add a print to my basket or when I try to "Continue to Checkout". It seems to frequently go blank when opening main.php
I've gone through the FAQ and generated the attached debug logs. I've tried changing between mysql, mysqlt, and mysqli to no avail. I've tried to delete the database cache, but Failed with this output:
Last Run Details:
Unable to delete directory: /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/entity
Successfully deleted directory: /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/theme
Unable to delete directory: /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module
I'm at a loss for what else to try. Any help is greatly appreciated.
Thanks
Posts: 16503
To be blunt, the root of the problem, you have a big Gallery on a low-end host. I see 3 options:
1) Delete a couple 10s of thousands of photos
2) Move to a different host; you're going to have to pay more and probably not get the space you need because you won't get the class of service you need to run such a site on a quality host because not a single quality hosts offers "unlimited" features. There is no such thing as unlimited disk space, bandwidth, domains, email accounts, etc
3) Live with it.
With over 77,000 images you have at a minimum of 231,000 files. With caching (which you need to help with performance) you've got at least another 3 per image, so that's 462,000 files, plus database cache files. That's a ton of files and that can impact performance on the servers, coupled with how all low-end hosts (every host that offered "unlimited" anything) like PowWeb way over sell their services. According to this tool, there's over 11,000 domains hosted on your IP. That could mean many, many more on the same server. http://www.domaintools.com/reverse-ip/
One observation I see though is that I'm seeing blank pages when clicking on your bread crumb. Try using the Matrix theme and see if the same behavior still happens.
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here
Posts: 133
Thanks nivekiam for taking the time to look at this problem.
Well, unfortunately, "living with it" is not an option. Without a working gallery, I'm out of business.
So, it sounds like there's nothing really to "fix". The problem is that I've outgrown the usefulness of my host. Can you suggest a host that could handle this kind of Gallery? I'm in Ontario, Canada if that makes any difference.
How complicated is moving a Gallery this size to another host? Is that something I could get done in Paid Support?
My show season ends in about a month. Is there anything I can do (other than deleting 10s of thousands of proofs) to keep it running until then?
I was planning on switching to something like Zenfolio, but not til my winter down time.
I'll be covering our Provincial Championships this weekend. If there is something that you or another developer can do, I'd be happy to pay for support to have it working on Monday.
What's my "bread crumb"? I'll try switching to Matrix and see what happens.
Posts: 6136
this issue seems to be related to the g2_highlightId bug on some systems.
http://www.google.com/search?q=blank+g2_highlightId+site%3Agallery.menalto.com
-s
FlashYourWeb and Your Gallery with The E2 XML Media Player for Gallery2
Posts: 133
I've tried switching to Matrix, but still get the blank pages.
Thanks for your input, suprsidr. If you could tell me where to put that code, I'll give it a try. It doesn't really say which file to add it to.
I'm a photographer, not an IT tech, so if you could explain it in layman's terms it would help me out alot.
Posts: 16503
The bread crumb is the "trail of links" near the top of each page to help navigate back to where you were.
Ah, thanks suprsidr, so it looks like this might not be a resource issue, which is what I was expecting at first glance. I looked at a few of those links that suprsidr posted. Let's try a few things.
Make sure your files are intact:
FAQ: How can I make sure that my installation files are all intact?
Disable URL Rewrite and make sure everything works as expected there. Site Admin > Plugins > and just disable URL Rewrite Then clear your cache:
FAQ: How can I clear cached data?
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here
Posts: 6136
I also want to add:
That site is extremely slow from my end.
I'm sure you are pushing the limits of your host with that many photos. Are you saying cannot "Archive" some of them?
Disable && uninstall any modules you don't need:
Basically any module listed under the display or extra data categories adds extra cycles to each request:
Random highlight - could be the root of your problem.
New Items, Rating, Comments.... - only if you need them.
-s
-s
FlashYourWeb and Your Gallery with The E2 XML Media Player for Gallery2
Posts: 133
Thanks! A lot of stuff to try here...
First off, I'm hesitant to disable the URL Rewrite. Last year I hired Andy Liebeman (sorry, I'm going by memory and probably got your name wrong) to secure my proofs from theft. He changed the way Gallery displays the photo pages to flash objects and part of that was enabling the URL Rewrite. I don't really understand what he did, but it works well. If you think I can disable the URL Rewrite without affecting the display, then I'll try it.
In the meantime, I'll go through and disable all the plug ins I'm not using. Yes, there are a lot. Since I don't know what a lot of them do, I thought it better to have them even if I don't need them, but I'll go and delete them.
System Check returned this:
Missing Files (64)
themes/fluid/locale/af/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/ar/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/cs/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/da/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/de/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/el/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/en_GB/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/es/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/es_AR/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/es_MX/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/eu/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/fi/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/fr/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/ga/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/he/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/hu/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/is/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/it/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/ja/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/lt/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/nl/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/no/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/pl/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/pt/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/pt_BR/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/ru/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/sr/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/sv/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/tr/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/vi/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/zh_CN/LC_MESSAGES/themes_fluid.mo
themes/fluid/locale/zh_TW/LC_MESSAGES/themes_fluid.mo
themes/fluid/po/af.po
themes/fluid/po/ar.po
themes/fluid/po/cs.po
themes/fluid/po/da.po
themes/fluid/po/de.po
themes/fluid/po/el.po
themes/fluid/po/en_GB.po
themes/fluid/po/es.po
themes/fluid/po/es_AR.po
themes/fluid/po/es_MX.po
themes/fluid/po/eu.po
themes/fluid/po/fi.po
themes/fluid/po/fr.po
themes/fluid/po/ga.po
themes/fluid/po/he.po
themes/fluid/po/hu.po
themes/fluid/po/is.po
themes/fluid/po/it.po
themes/fluid/po/ja.po
themes/fluid/po/lt.po
themes/fluid/po/nl.po
themes/fluid/po/no.po
themes/fluid/po/pl.po
themes/fluid/po/pt.po
themes/fluid/po/pt_BR.po
themes/fluid/po/ru.po
themes/fluid/po/sr.po
themes/fluid/po/sv.po
themes/fluid/po/tr.po
themes/fluid/po/vi.po
themes/fluid/po/zh_CN.po
themes/fluid/po/zh_TW.p
Modified Files (1)
modules/core/classes/GalleryPhotoItem.class
All other System Checks were successful.
I'll update when I've disabled the plug ins.
Thanks again!
Posts: 133
I've disabled a number of plug ins.
Deleting the Module Settings cache returned this:
Deleting dir: /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module/httpauth
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module/albumselect/0/0
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module/albumselect/0
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module/albumselect
Permission denied removing file /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module/archiveupload/0/0/0.incGi42uO
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module/archiveupload/0/0
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module/archiveupload/0
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module/archiveupload
Permission denied removing file /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module/captcha/0/0/0.inccP0aiS
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module
Unable to recreate dir: /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module
Since I disabled the album select and archive upload, I'm guessing that is the reason for those errors.
Deleting Theme Settings cache returned this:
Deleting dir: /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/theme
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/theme/carbon/0/0
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/theme/carbon/0
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/theme/carbon
Unable to remove directory /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/theme
Unable to recreate dir: /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/theme
I could not delete the Albums and Photo Data cache due to server time out.
All other caches deleted successfully (except, of course, Install/Upgrade log files and Thumbnails and Resizes)
My server error log is attached. I cleared it last night when I started getting these blank pages, so the errors are fresh.
Still getting blank pages, though.
Any other ideas...??
Posts: 16503
Ah, I didn't notice that before that you were unable to delete cached data...
Check your permissions, something isn't right, these FAQ should help out there:
FAQ: How can I fix the problem with the Storage Directory Permissions reported by the Upgrade Wizard?
FAQ: I get a ERROR_PLATFORM_FAILURE, what should I do?
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here
Posts: 16503
And that would be a restriction on PowWeb's servers. Either their settings are low or you've got a busy site.
I also didn't notice this before, database locking. Try changing that to file locking under Site Admin > General (first page you land on)
You might be able to delete the cache manually using the /lib/support tool explained here:
FAQ: How can I clear cached data? I'm not sure if the delete cache tool under the maintenance section makes DB calls, but I know the tool under /lib/support does not, it just tries to delete the directories.
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here
Posts: 133
I do have a busy site, but purchased an increase in database queries from Powweb. I should have 150k per hour now. Can't believe it's still maxing out!
I had switched from File to Database locking because I was getting ERROR_LOCK_TIMEOUT (or something like that). Setting it to Database Locking seemed to fix the problem, so I left it.
I switched it back to File locking, but still getting the blank pages.
The path to my g2data directory in config.php is correct.
g2data is 777. Does that need to be changed?
UPDATE: when I tried the "Make the data folder read/write" in lib/support, I get a blank page after entering the password.
After a few tries, I WAS able to delete the database cache in Admin -> Maintenance! That's new!
Last Run Details:
Successfully deleted directory: /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/entity
Successfully deleted directory: /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/theme
Successfully deleted directory: /home/users/web/b17/pow.andrewb/htdocs/g2/g2data/cache/module
Still getting blank pages....
Since all the bread crumbs are generating blank pages, should I try disabling the g2_highlightId?
If so, could you tell me where to put the commands?
Thanks again.
Posts: 133
hey Hey!
I don't know what I did, or maybe the techs at Powweb did, but it seems to be working now!
The bread crumbs, the shopping card buttons, and the Admin Maintenance tasks all seem to be working properly
Could you do me the favour of checking it from your end?
Latest system info:
Gallery URL = http://www.photosbybailini.com/g2/main.php
Gallery version = 2.3 core 1.3.0
API = Core 7.54, Module 3.9, Theme 2.6, Embed 1.5
PHP version = 4.4.9 cgi
Webserver = Apache
Database = mysqlt 5.0.83-log, lock.system=flock
Toolkits = ImageMagick
Acceleration = partial/3600, partial/3600
Operating system = Linux cgi0702.int.bizland.net 2.6.33.3-nx #1 SMP Tue May 11 14:02:11 EDT 2010 i686
Default theme = carbon
gettext = enabled
Locale = en_GB
Browser = Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_5_8; en-us) AppleWebKit/533.17.8 (KHTML, like Gecko) Version/5.0.1 Safari/533.17.8
Rows in GalleryAccessMap table = 1079
Rows in GalleryAccessSubscriberMap table = 77293
Rows in GalleryUser table = 221
Rows in GalleryItem table = 77290
Rows in GalleryAlbumItem table = 2697
Rows in GalleryCacheMap table = 303
Also, the locking system is still set to file. Should I change that back to database to avoid the ERROR_LOCK_TIMEOUT that I was getting before?
Thank you, THANK YOU for all your help!
Posts: 16503
Personally, I'd leave it at file locking for the time being and see how things go. Keep your template/database cache cleaned out on a somewhat regular basis and all should be fine.
Most installs don't need that sort of hand holding, but larger installs with heavy use (just as with anything) need more maintainence. And everything is looking good from my end, slow but good.
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here
Posts: 133
I'll definitely keep on top of the cache maintenance from now on. I had never tried deleting the database cache until I started getting the lock timeouts, then the process wouldn't finish due to the resource limits on the server.
Now that it's clean, I'm hoping it won't be so difficult to keep it that way.
Once again.... THANK YOU to both suprsidr and yourself.
From here, I'll gladly be going to your "Donate" page!
Posts: 133
By the way, just how "slow" is my Gallery running?
I don't have any other galleries to compare it to, so I thought it was running fairly well.
My guess would be that since deleting all the caches, the next few visits will be slow as Gallery recreates them.
Does that make sense or am I misunderstanding how Gallery works...?
Posts: 16503
It's slow IMO. Even before the caches were cleared and even if I revisit a page, just clicking on a thumbnail to go to the next page, nothing happens for a few seconds. Once the page actually starts loading it's not bad. I've seen worse and yours wouldn't drive me away, but it could some other people. The ones I've seen that were worse I've just stopped browsing them.
Your site is hard to browse because it seems to take 8+ clicks to get to the actual photos for a lot of stuff, but that's all in how you're photos are organized in albums.
For example on this page (which I've visited a few times now, so it's in cache)
http://www.photosbybailini.com/g2/v/Equine/2008_Equine/
I click on the Richland Park album (which I've done a few times now, so it's also in cache), it takes a few seconds before anything happens. I'm not clearing my browser cache or anything and a lot of that could/should be cached by Gallery. You could probably ramp up the "Acceleration" under Site Admin > Performance and set Guests to Full Acceleration.
Check out my G2 install below for a comparison. Granted it's not as large as yours by any means, but with G2's architecture size shouldn't matter and if it does it's many times larger than your G2 install (or probably any G2 install you've seen)
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here
Posts: 133
Thanks for the feedback.
I used to have the Album Tree on each page. When it worked, it was a great browsing tool. However, it didn't take too long before it started causing errors. Probably a resource limit issue with the server again since I have quite a number of albums. Removing that plug in fixed the errors.
I found that with Full Acceleration the shopping cart was not being updated when an item was added. If memory serves me well, refreshing the page would update it, but I felt that was a little too confusing for my customers, so reset it to Partial Acceleration to avoid that problem.
Your Gallery seems to be blazing fast compared to mine! I chalked it up to the number of items I have, but you say that shouldn't affect it. Could the fact that I'm on Partial Acceleration be the difference?
Posts: 16503
Yeah, some plugins like that don't lend themselves well to big galleries
Do'h I forgot about the cart. I had it stuck in my head that you didn't have any real dynamic content being displayed.
Partial Acceleration if anything is helping the speed of your site. I just turned off all acceleration and caching and cleared out the database and template cache on my site. So you can see what it's like now. I could add a few thousand photos and a few 100 albums, but IMO that would just be wasting resources and as I'm on a shared host and I like to play Mr. Nice Neighbor
O.k. Actually I'm in the process of adding several thousand photos to a test G2 install on my VPS right now, once that's done, I'll PM you a link so you can check that out.
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here