SOS: Need file folders for albums to provide to Google Images Safe Search

OC2PS
OC2PS's picture

Joined: 2010-09-08
Posts: 405
Posted: Thu, 2010-09-09 12:36

Google has indexed many of my images via Gallery and elsewhere. However, when Image Search is run, they don't show up. Apparently, Google feels, for whatever reason, that my images don't belong in Google Images - Safe Search...so these don't show up unless the searcher turns off his/her Safe Search option.

I have identified certain albums that *could* be inappropriate for some of the audience and have provided Google a list of these albums. Unfortunately, Google requires actual folders for the actual files so that they can put these in the *unsafe* category and mark the rest of my site as SAFE. http://www.google.com/support/forum/p/Webmasters/thread?hl=en&tid=65a31945a70e73b8&start=520

Now, I have found the folders where these files are stored
http://www.csillamvilag.com/galeria_images/albums/Seeboden 2009
http://www.csillamvilag.com/galeria_images/albums/WBPF08
http://www.csillamvilag.com/galeria_images/albums/WBPF09
http://www.csillamvilag.com/galeria_images/albums/Reklamok
http://www.csillamvilag.com/galeria_images/albums/random_testfestes
http://www.csillamvilag.com/galeria_images/albums/hirneves
(my Gallery 2 installation is at http://www.csillamvilag.com/galeria/galeria and works fine)

However, these folders or the files in them are not accessible by pointing my URL box to the correct address!! I get the error message Directory has no index file.

So, if someone can suggest how I can provide the correct folders for these albums to Google, I'd (hopefully) be able to have my images listed back in Google Image search. Please help!

SoosKriszta
Csillamvilag.com

Bodypainting, Facepainting, Glitter, Henna
Materials, Courses, Resources

 
nivekiam
nivekiam's picture

Joined: 2002-12-10
Posts: 16503
Posted: Thu, 2010-09-09 16:22

Please don't post the same question multiple times. I saw your question before, but don't really have an answer for you. Although, I guess this is getting you an answer because I didn't look at this again and think about the problem a bit more.

The images at:
csillamvilag.com/galeria_images/albums/

shouldn't be getting crawled to begin with. For Gallery2, your g2data directory should never be web accessible. Also there are no direct links (or shouldn't be) to that directory so it wouldn't get crawled.

In G2, your images go through an "image firewall", so a URL to say a specific thumbnail would look like this:
csillamvilag.com/galeria/galeria/d/1092-2/Verseny.jpg

Granted every time you rebuild your thumbs and resizes, that will or could change.

Quote:
I have identified certain albums that *could* be inappropriate for some of the audience and have provided Google a list of these albums. Unfortunately, Google requires actual folders for the actual files so that they can put these in the *unsafe* category and mark the rest of my site as SAFE. http://www.google.com/support/forum/p/Webmasters/thread?hl=en&tid=65a31945a70e73b8&start=520

o.k. So as I read this multiple times and read just that specific page of that huge thread you linked to it sounds like you're needing to allow google to browse those directories. If that /galeria_images/ directory is in fact your g2data directory, that is HUGELY bad advice for Gallery2.

The other problem I see is that those URLs to those "unsafe" images will not match the URLs to the "unsafe" images that Gallery is giving out. So you either run the risk of all this work either not working, or getting flagged as having unsafe images again.

Here's some really bad advice:
You could try putting an .htaccess file in your /galeria_images/albums directory or just in those individual directories to nail it down even further that can try turning directory browsing on.

Put this in the .htaccess file
Options +Indexes

You should really investigate looking at migrating to G3. The directory that stores the images in G3 is and has to be web accessible because the architecture has changed from G2 and the "image firewall" is no more in G3. However, with your host you'd still be having the problem of no directory browsing.

But once you enable directory browsing, then in G3 the URLs for the images will match what Gallery is serving up too.
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here

 
OC2PS
OC2PS's picture

Joined: 2010-09-08
Posts: 405
Posted: Thu, 2010-09-09 20:27
nivekiam wrote:
Please don't post the same question multiple times.

Sorry about the double post. After posting the first one as a response to a very old and somewhat unrelated query in General Discussion, I felt that maybe this board would be more appropriate for my question.

Here's the exact detail of what happened:
http://www.google.com/support/forum/p/Webmasters/thread?hl=en&tid=65a31945a70e73b8&start=469

sooskriszta wrote:
I run a bodypainting supplies webshop. Recently ALL my images disappeared from Safesearch ON and MODERATE.

99.9% of the images on my site are images of products (packages with henna, glitter, glue etc), usage directions (how to make a henna tattoo...), or general facepainting/bodypainting images (e.g. fans at world cup 2010). These should all, and earlier used to, appear in Safesearch ON.

A very very small section of the images - news images from world bodypainting festival - could possibly be called candidates for Safesearch MODERATE. And all these images are neatly organized in a separate album.

Please help!

site: www.csillamvilag.com

Google wrote:
What's the directory where the Moderate images are?

loupiote wrote:
google recommends that you segregate the unsafe image files (i.e. the jpeg's) in separate directories.

so i think Google was asking in what directory the actual images are.
e.g. http://www.csillamvilag.com/galeria/galeria/d/312-2/2009-07-17+Seeboden+059.JPG

sooskriszta wrote:
As you would expect, the directories are private for site security reasons.
Since
http://www.csillamvilag.com/galeria/galeria/d/312-2/2009-07-17+Seeboden+059.JPG
is at http://www.csillamvilag.com/galeria/galeria/v/WBPF09/Show/2009-07-17+Seeboden+059.JPG.html
i.e. it is in the gallery http://www.csillamvilag.com/galeria/galeria/v/WBPF09/Show/
Therefore it is in the folder http://www.csillamvilag.com/galeria_images/albums/WBPF09/Show

Since the folders are not public, that is why I provided the galleries in the first place instead of the folders.

Google wrote:
The images team says it would be helpful if you can provide the actual directories that the image files are hosted in, not just the pages on which the images appear. Thanks!

nivekiam wrote:
sounds like you're needing to allow google to browse those directories.

Seems like that. Based on the above discussion with Google, if you have other suggestions, I'm happy to try them out too....in fact would highly appreciate them...

nivekiam wrote:
You should really investigate looking at migrating to G3. The directory that stores the images in G3 is and has to be web accessible because the architecture has changed from G2 and the "image firewall" is no more in G3. However, with your host you'd still be having the problem of no directory browsing.

But once you enable directory browsing, then in G3 the URLs for the images will match what Gallery is serving up too.

What stage is G3 at? Is it still a release candidate or has a stable version been released? Also, can I easily upgrade from G2 to G3?

SoosKriszta
Csillamvilag.com

Bodypainting, Facepainting, Glitter, Henna
Materials, Courses, Resources

 
nivekiam
nivekiam's picture

Joined: 2002-12-10
Posts: 16503
Posted: Thu, 2010-09-09 20:43

I see one real option with G2. Don't use G2 for google to crawl those images. Manually create a static HTML page pointing to direct images to show case your stuff that's safe.

O.k. option 2 would be to make sure that no questionable image can be accessed by anyone just browsing your gallery and they have to have a login, that should make Google think the site is safe.

G3 is currently in RC, but a stable 3.0 release should be out soon:
http://gallery.menalto.com/gallery_3_0_is_almost_ready
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here

 
OC2PS
OC2PS's picture

Joined: 2010-09-08
Posts: 405
Posted: Thu, 2010-09-09 21:49
nivekiam wrote:
I see one real option with G2.

Neither option is particularly palatable

nivekiam wrote:
Don't use G2 for google to crawl those images. Manually create a static HTML page pointing to direct images to show case your stuff that's safe.

For 10s of 1000s of images, obviously this is tedious. Besides the gallery is a living beast....new images keep getting added all the time...manual is not practical.

nivekiam wrote:
option 2 would be to make sure that no questionable image can be accessed by anyone just browsing your gallery and they have to have a login, that should make Google think the site is safe.

Again, I want people to be able to view the images without logging in...it's a public site...a specific interest one....

Is there an better option?
e.g. Putting a robots.txt in some folders to prevent Google from browsing them, or
Checking a flag somewhere so that some albums are not included in the sitemap,
etc?

SoosKriszta
Csillamvilag.com

Bodypainting, Facepainting, Glitter, Henna
Materials, Courses, Resources

 
nivekiam
nivekiam's picture

Joined: 2002-12-10
Posts: 16503
Posted: Thu, 2010-09-09 21:59
Quote:
e.g. Putting a robots.txt in some folders to prevent Google from browsing them, or

robots.txt can only be put at and read from the root of your site. Those folders are not getting crawled because nothing except for a few posts you've posted on the internet links to them directly. Nothing in Gallery2 will ever link directly to your g2data/albums directory.

G3 is the only potential option I see where the URLs for the images are a direct link to the actual image, so you could exclude directories. In G2, the URLs for the images are never a direct link to the actual image sitting on the file system, so you can exclude directories all you want, but Google will have never crawled those directories anyway and will probably continue to see the rest of your site as unsafe because Gallery2 will continue to dish those "unsafe" images up to guests (including Google).
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here

 
OC2PS
OC2PS's picture

Joined: 2010-09-08
Posts: 405
Posted: Fri, 2010-09-10 08:04

"Upgrading" seems the best course of action, as per your advice. I'll do that as soon as a new version is available.

I put upgrading in quotes as based on what I have read around the forums, one can't really upgrade from G2 to G3 - rather it's a matter of migrating from G2 to G3...I just hope that the import tool works well...

SoosKriszta
Csillamvilag.com

Bodypainting, Facepainting, Glitter, Henna
Materials, Courses, Resources

 
nivekiam
nivekiam's picture

Joined: 2002-12-10
Posts: 16503
Posted: Fri, 2010-09-10 09:39

G3 is really close to final release. You can have G2 and G3 running side by side. I'd suggest installing G3 into a different directory and testing to start with. If there's a major problem importing your stuff, now is the time. There is a lot of functionality in G2 that isn't in G3 and I don't know if you use that in G2 or not.
____________________________________________
Like Gallery? Like the support? Donate now!!! See G2 live here