Googlebot-Image indexing hundreds of useless thumbs and a few pics Googlebot-Image indexing hundreds of useless thumbs and a few pics
 

News:

CPG Release 1.6.27
change DB IP storage fields to accommodate IPv6 addresses
remove use of E_STRICT (PHP 8.4 deprecated)
update README to reflect new website
align code with new .com CPG website
correct deprecation in captcha

Main Menu

Googlebot-Image indexing hundreds of useless thumbs and a few pics

Started by flapane, October 31, 2014, 07:20:28 PM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

flapane

If I check the gallery indexed photos in Google Images ( site:flapane DOT com SLASH gallery ), I notice that there are just a few pics (normal_$nameofthefile.jpg) and hundreds of useless thumbs (thumb_$nameofthefile.jpg).
I wonder why Googlebot-Image indexed only a few images, and why it indexed a lot of small thumbnails. I have no robots.txt rules for Googlebot-Image, but I wonder if I'd better adding:
User-Agent: Googlebot-Image
Disallow: /gallery/thumbnails.php?*


As a sidenote, my robots.txt already contains:
User-Agent: *
Allow: /
Disallow: /gallery/addfav.php?*
Disallow: /gallery/login.php?*
Disallow: /gallery/thumbnails.php?album=*slideshow
Flapane
www.flapane.com

Gallery
www.gallery.flapane.com

flapane

I've just put this in robots.txt.
User-agent: Googlebot-Image
Disallow: /gallery/albums/*/thumb_*.jpg$

I'll check the results in the next days/weeks.
It seems to work, as far as GWT is concerned.
Flapane
www.flapane.com

Gallery
www.gallery.flapane.com

flapane

Uhm, it looks like after three weeks the thumbs are all still there. In theory, the trick should work.
It's strange, because Google bots are usually waaaay faster than Bing ones.
Flapane
www.flapane.com

Gallery
www.gallery.flapane.com