SEF_URLs plugin for cpg1.5.x

[flapane]

Check the difference with bingbot:

157.55.35.96 - - [11/Sep/2013:17:34:36 +0200] "GET /gallery/mostra-1-891-_Gaiola_Calata_Trentaremi_2_.html HTTP/1.1" 200 9432 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"

[flapane]

msnbot-media

65.55.215.97 - - [11/Sep/2013:07:11:51 +0200] "GET /gallery/albums/viaggio-newyork/normal_DSC_1187.jpg HTTP/1.1" 200 100679 "-" "msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)"

[flapane]

I forgot another error which is peculiar to googlebot:

Code Select Expand

[Mon Sep 16 11:44:43 2013] [error] [client 66.249.73.104] File does not exist: /foo/bar/public_html/displayimage.php

Actually, it should be /foo/bar/public_html/gallery/displayimage.php

[flapane]

It also causes redirect loops:

Code Select Expand

[Tue Oct 01 10:29:40 2013] [error] [client 66.249.66.62] Request exceeded the limit of 10 internal redirects due to probable configuration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace.

Also, hundreds of 404 errors noticed in Google Webmaster Tools.
If this suddenly started in September with googlebot only, then Google maybe changed googlebot algorithms. Unfortunately, Google brings the majority of referral traffic on 99% of the website, and I have no idea of any workarounds.

[Niecher]

Hello flapane,

I suggest you use the flags [QSA,NC,L] instead of [NC] to rewrite all urls.

Regards.

[flapane]

Hello Niecher.
Thanks for your contribution, I'll let you know if anything changes.

[flapane]

Here's the error log from the last 20 minutes. Thye're from a spanish ip, is that you?
Did you get any http 500 messages? Those seems to be redirect loops.

Code Select Expand

CUT

[Niecher]

Yes, I am.

I was watching your gallery, and you have some errors in different albums.

If you can post your code htaccess in a text file (sef_urls part only, of course) and codebase.php file (both, in a zip file) there may be a solution.

Regards.

[Niecher]

where you have the htaccess file in your root folder or in your gallery folder?

[flapane]

Sure, here's the .htaccess (in gallery folder. Also, I tried enabling and disabling RewriteBase without luck) http://pastebin.com/G4dD1iD0
Attached is codebase.php.
In the meanwhile, I've noticed http500 errors on any "most viewed" (popolari.html) and "most voted" (migliori.html) pages.

Just as a sidenote, a few days ago I tried to download the plugin from scratch, and use the english version of .htaccess. There were the same errors I posted in the last weeks.
Thanks a lot for your help.

[Niecher]

Ok, I'll come back here later. I will look.

Regards.

[Niecher]

Hello flapane,

In your codebase.php file you should remove the hash mark in specific language replacement as well as in all str_tdm variables, except for the Swedish language is right.

The most important problem, error 500, for the albums mentioned, part of the previous point and this is because you use the word top to rewrite top_display_media in both codebase.php and htaccess files.

I suggest that if you want to use top_display_media as it's, delete the corresponding line in your htaccess file or otherwise use in_alto, alto, up or any other synonym for both files also.

Another mistake that is not noticeable, because that is not strictly marking a beginning and an end to the rule (^ $), you will find it to the variable $str_contact = 'contatto' (and its counterpart) in the htaccess file RewriteRule ^contatti.html(.*) contact.php$1

And for RewriteBase, I suggest you use RewriteBase /gallery/

Regards.

[flapane]

Hello,
- I've removed the hash mark in language replacement line (303) and in str_tdm but for Swedish (where there wasn't a hash mark and I added it).
- I've deleted the top_display_media line in .htaccess (good point, I never noticed that).
- $str_contact variable has been replaced with "contatti"
- contatti.html(.*) in .htaccess has been replaced with ^contatti.html(.*). I wonder if I should do the same thing for the cerca.html(.*) rewrite rule.
- Rewritebase path has been updated

I'll check the error log and keep you updated.
In the meanwhile, thank you so much.

[Niecher]

I meant that you should not put hash mark on the line 303 and also on any variable str_tdm for any language as it appears in the Swedish language properly. (Perhaps the google translation was not correct    ). Therefore, do not add hash mark to Swedish.

You had problems with the English language because it also had hash mark.

You have removed the line RewriteRule (.*)top(.*) $1top_display_media$2, but remember that the variable str_tdm in Italian language should be $str_tdm = 'top_display_media';

I just visited your gallery, and there is no 500 error for the albums mentioned.

Regards.

[flapane]

Sure, I removed the hash mark from line 303, I didn't put it.

Code Select Expand

$html = str_replace('top_display_media',$str_tdm,$html);

I removed the hash mark from Swedish and now there aren'y any hashes inside $str_tdm variables.
Let's hope Googlebot likes the new configuration, we'll see in the next hours. 

[Niecher]

Surely you will not get google errors now.

Google errors were being shown when the googlebot tracked the popolari and migliore albums since visiting these albums returned 500 error.

These albums work well now.

Regards.

[flapane]

Glad to hear it, thanks again.
What amazes me is that such errors weren't shown in the error log on the previous server where I hosted my website until August, and in Google Webmaster Tools too.
It's a pity that the original developer disappeared and can't update the original plugin.

[flapane]

Unfortunately, Googlebot still tries to crawl weird urls such as

66.249.66.62 - - [06/Oct/2013:22:05:04 +0200] "GET /gallery/displayimage-1-8.htmlalbums/userpics/10001/albums/viaggio-newyork/mostra-cerca-0-12-_Via_Caracciolo_dinverno_.html HTTP/1.1" 200 5435 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

I wonder if I should add start ^ and end $ of the rule on EVERY line of .htaccess file.

[flapane]

Just a short test: I added ^ and $ delimitators on ALL the rewrite rules, but nothing changed. Still htmlalbums-like urls being crawled from Googlebot.

[Niecher]

Hello flapane,

I think you have a little concern with all of these prompts. These are not mistakes of his gallery.

The 500 error is solved successfully.

You have been indexed by google with different urls, and google searches to check the contents, for example:

http://www.test.com/gallery/displayimage-1-8.html
http://www.test.com/gallery/mostra-8-_Golfo_di_Napoli_al_tramonto_.html

Regards.

[Edit André: replaced URL by request]