What are the limits? Can G2/3 handle 100,000 images and more?
|
RRGDI
Joined: 2009-05-21
Posts: 12 |
Posted: Tue, 2009-06-02 01:54
|
|
I wasn't sure which forum, I apologize if this is badly placed. I am looking to rebuild an existing website in Drupal with Gallery. I have about 100,000 images total right now, including thumbnails. What I'm trying to do is use IPTC keywords to make the database searchable with the results displayed as a thumbnail gallery that clicks to the main image. Someone just told me today that Gallery wouldn't be able to handle this after all. This person said: Quote:
it’s just that it’s not designed to create a mega database to process that many files. and Quote:
hat you want to do, is easy, but technically, G2 will never handle the load. One pic is actually a minimum of 7 files to G2 (‘cause of the way it processes) and probably a good bit more, if you plan to independently tag outside of G2 with, say, Bridge or other. So, at 100k images, you are talking about 700k files? Cache will not handle this load. The most I’ve ever seen G2 handle was apx. 9k pics. I’ve heard some folks brag, but never proved to me. The search part. The pics are going to need some random tags – having them identical will defeat your effort. I need to know what it can really do and not do. Help! thanks! |
|
Posts: 16503
Only limited by your hardware as far as we've seen.
G2, easily, but depends on the hardware. I seriously doubt you'll get away with hosting that many files on a shared host, Gallery or not. G3, most likely yes and many, many times more. But it's still in development and I haven't seen or heard of anyone with a huge deployment of it yet.
That person doesn't have a clue what they are talking about. Possibly hasn't even used the software or if they have and that's their opinion it was on piss poor hardware or a crappy host or both. He might have been thinking of G1 or some other photo hosting software too.
Here's some people using Gallery to host many times more than 9,000 photos
http://codex.gallery2.org/Gallery2:Scalability
I'd have to ask, but I'm pretty sure these are hosted on the same server or at least by the same person (Along with a couple other sites that have Gallery installed, that I know of)
http://ckdake.com/gallery/
http://gallery2.jpmullan.com/
http://gallery.menalto.com/care2_hits_1m_photos
(they are well past the 1 million mark now)
http://www.care2.com/c2c/photos/
http://codex.gallery2.org/Gallery2:Performance_Tips
http://codex.gallery2.org/Gallery2:ACL_Performance
http://gallery.menalto.com/node/80867
http://gallery.menalto.com/node/87620
EDIT: here's one more link: (I knew I'd seen someone mention Gallery while I've been reading over posts at Linode)
http://www.linode.com/forums/viewtopic.php?p=14766#14766
Follow his link and he has over 11,000 photos publicly accessible. Not the 100k you're looking for, but over 9k of the person you were talking to.
BTW, G3 should be even better as serving up and handling large amounts of images with less resources.
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here
Posts: 4338
Tell your friend to PM me. I have 50k images in one installation and it doesn't even pause to breathe - For about 1000 visitors a day, the average processor utilization is <1%. If your server allows G2 the processor resource it needs (specifically: you're not sharing the server with fifteen thousand other websites at $5 per month), and if you don't have a million visitors per day, then 100k, 1 million (whatever) images are no problem. If your hosting provider inserts arbitrary limits on file-handles, processor time and other gubbins then you might find that even 1000 images will "overload".