Googlebot-Image indexing hundreds of useless thumbs and a few pics Googlebot-Image indexing hundreds of useless thumbs and a few pics
 

News:

CPG Release 1.6.26
Correct PHP8.2 issues with user and language managers.
Additional fixes for PHP 8.2
Correct PHP8 error with SMF 2.0 bridge.
Correct IPTC supplimental category parsing.
Download and info HERE

Main Menu

Googlebot-Image indexing hundreds of useless thumbs and a few pics

Started by flapane, October 31, 2014, 07:20:28 PM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

flapane

If I check the gallery indexed photos in Google Images ( site:flapane DOT com SLASH gallery ), I notice that there are just a few pics (normal_$nameofthefile.jpg) and hundreds of useless thumbs (thumb_$nameofthefile.jpg).
I wonder why Googlebot-Image indexed only a few images, and why it indexed a lot of small thumbnails. I have no robots.txt rules for Googlebot-Image, but I wonder if I'd better adding:
User-Agent: Googlebot-Image
Disallow: /gallery/thumbnails.php?*


As a sidenote, my robots.txt already contains:
User-Agent: *
Allow: /
Disallow: /gallery/addfav.php?*
Disallow: /gallery/login.php?*
Disallow: /gallery/thumbnails.php?album=*slideshow
Flapane
www.flapane.com

Gallery
www.gallery.flapane.com

flapane

I've just put this in robots.txt.
User-agent: Googlebot-Image
Disallow: /gallery/albums/*/thumb_*.jpg$

I'll check the results in the next days/weeks.
It seems to work, as far as GWT is concerned.
Flapane
www.flapane.com

Gallery
www.gallery.flapane.com

flapane

Uhm, it looks like after three weeks the thumbs are all still there. In theory, the trick should work.
It's strange, because Google bots are usually waaaay faster than Bing ones.
Flapane
www.flapane.com

Gallery
www.gallery.flapane.com