Disuppearing images. Disuppearing images.
 

News:

cpg1.5.48 Security release - upgrade mandatory!
The Coppermine development team is releasing a security update for Coppermine in order to counter a recently discovered vulnerability. It is important that all users who run version cpg1.5.46 or older update to this latest version as soon as possible.
[more]

Main Menu

Disuppearing images.

Started by zamirzamir, December 02, 2006, 03:49:57 AM

Previous topic - Next topic

0 Members and 2 Guests are viewing this topic.

zamirzamir

Hello all,

This is one of the strangest problems I've had.

Some time ago, I had to completely reload the backup for my web site and it messed up something in the Gallery.
The problem I have right now is that some RANDOM images disuppeared from the Gallery, but I can still open them with a direct link. Which means that files are still on the server in the same place as they were before, but Gallery doesn't see them for unknown reason.
Maybe it's a problem with My SQL database, but I'm not sure where even to start looking for fix.

I used to have over 5200 images in gallery, now it's showing that i have about 4200 images, also the VIEW counters show much less then they used to show.

Please help.

Joachim Müller

Post a link (preferably a deep link to one of the "missing" pics).

zamirzamir

Quote from: GauGau on December 02, 2006, 07:38:55 AM
Post a link (preferably a deep link to one of the "missing" pics).

The whole folder is empty
http://www.adygaunion.us/gallery/thumbnails.php?album=249

(https://coppermine-gallery.com/forum/proxy.php?request=http%3A%2F%2Fwww.adygaunion.us%2Fgallery%2Falbums%2Fuserpics%2F10002%2Fthumb_15_Murat_Dishek%252C-%25CF%25F0%25EE%25F2%25E8%25E2%25EE%25F1%25F2%25EE%25FF%25ED%25E8%25E5-%252C-Resistance-%252C70x80cm%252Coil.jpg&hash=c94688ee418a6dc80c2c6fa9e83d66d76907466b)



Folders used to have many files now empty
http://www.adygaunion.us/gallery/index.php?cat=56

(https://coppermine-gallery.com/forum/proxy.php?request=http%3A%2F%2Fwww.adygaunion.us%2Fgallery%2Falbums%2Fuserpics%2F10005%2Fthumb_s_Crimovym.jpg&hash=14920f488ce67a40cd98a271eaa00c422e145a74)

you can see all the images in this article, but gallery doesnt show them any more.
http://www.adygaunion.us/rus/index.php?option=com_content&task=view&id=122&Itemid=75


I can find more like that.....over 1000 images are missing ((

Joachim Müller

See my reply on the other unrelated thread that you have started:
Quote from: GauGau on December 03, 2006, 11:17:28 AM
You're using cpg1.4.4, while the most recent version is cpg1.4.10. It's mandatory to upgrade before doing anything else. Won't look into your issues before you are done upgrading. Please reply once you're done.

donnoman

I would bet that either you've had some mysql corruption or your host restored their mysql server without telling you.

I would upgrade first, just to make sure its not corruption of coppermine files themselves (I doubt it), then use phpmyadmin and do some health checks of the database.

If that doesn't solve the problem, then I would use the cpgmassimport plugin, to bring in all of the images that aren't currently in the database.

zamirzamir

Quote from: GauGau on December 03, 2006, 11:21:11 AM
See my reply on the other unrelated thread that you have started:

No problem, do I just upgrade from 1.4.4 to 1.4.10 right away ? where would the files be ?

zamirzamir

Quote from: donnoman on December 04, 2006, 12:43:17 AM
I would bet that either you've had some mysql corruption or your host restored their mysql server without telling you.

I would upgrade first, just to make sure its not corruption of coppermine files themselves (I doubt it), then use phpmyadmin and do some health checks of the database.

If that doesn't solve the problem, then I would use the cpgmassimport plugin, to bring in all of the images that aren't currently in the database.

Quick question before we move on. is cpgmassimport plugin something additional i need to install ? sounds like what i need.

Stramm


Joachim Müller

Quote from: zamirzamir on December 05, 2006, 11:46:44 AM
No problem, do I just upgrade from 1.4.4 to 1.4.10 right away ? where would the files be ?
Upgrade as suggested in the documentation.

zamirzamir

Ok, I updated to new version, and installed the Plug In for Mass Import.

Now the gallery is really messed up (((
Some albums dont open, some files dont open. All the names that were in russian show as some signs...... I was afraid of bad outcome....and it happened.
what do I do now ?

Joachim Müller

Quote from: zamirzamir on December 06, 2006, 08:04:53 AM
Ok, I updated to new version, and installed the Plug In for Mass Import.
You should have checked first that the upgrade went flawlessly before fiddling with a mod/plugin. Take one step at a time.

Quote from: zamirzamir on December 06, 2006, 08:04:53 AM
Some albums dont open, some files dont open.
As suggested: post deep links.

Quote from: zamirzamir on December 06, 2006, 08:04:53 AM
All the names that were in russian show as some signs
Did you read the documentation carefully? You have set your encoding to utf-8, while your textual content is in your old encoding. Either switch encoding back as it used to be or convert your textual content to utf-8.

Quote from: zamirzamir on December 06, 2006, 08:04:53 AM
I was afraid of bad outcome....and it happened.
Well, if you did as suggested in the docs, then you should have backups of everything, so you could savely go back in case that you're not able to solve your issues.

Quote from: zamirzamir on December 06, 2006, 08:04:53 AM
what do I do now ?
Take one step at the time, not several. I recommend starting by changing your encoding first. As you have mixed content (English and Russian), I suggest converting your textual content to utf-8 Using charsetmgr.php). After you did, reply again here.

zamirzamir

Quote from: GauGau on December 06, 2006, 08:14:49 AM
You should have checked first that the upgrade went flawlessly before fiddling with a mod/plugin. Take one step at a time.
As suggested: post deep links.
Did you read the documentation carefully? You have set your encoding to utf-8, while your textual content is in your old encoding. Either switch encoding back as it used to be or convert your textual content to utf-8.
Well, if you did as suggested in the docs, then you should have backups of everything, so you could savely go back in case that you're not able to solve your issues.
Take one step at the time, not several. I recommend starting by changing your encoding first. As you have mixed content (English and Russian), I suggest converting your textual content to utf-8 Using charsetmgr.php). After you did, reply again here.

You're right, I should've checked before installing a plug in....but i never used it anyways.
I did everything step by step as suggested in documentation, saved backup of database and 2 files.
trying to check the change of textual contents,
windows-1251 to koi8-r  is the proper convertion for all my albums and files to show up correctly.

Now for some reason menu buttons are messed up when choosing Russian language.

zamirzamir

Quote from: zamirzamir on December 06, 2006, 08:31:15 AM
You're right, I should've checked before installing a plug in....but i never used it anyways.
I did everything step by step as suggested in documentation, saved backup of database and 2 files.
trying to check the change of textual contents,
windows-1251 to koi8-r  is the proper convertion for all my albums and files to show up correctly.

Now for some reason menu buttons are messed up when choosing Russian language.

final conversion was to UTF8 unicode. so everything is matching now. now funky letters.

Hopefully we can check on the files to bring them back.

Joachim Müller

OK, fine - one issue less that needs looking into. Now on to the next issue: the missing pics.
Quote from: GauGau on December 06, 2006, 08:14:49 AM
As suggested: post deep links.

zamirzamir

Quote from: GauGau on December 06, 2006, 08:53:59 AM
OK, fine - one issue less that needs looking into. Now on to the next issue: the missing pics.

Here you go
http://www.adygaunion.us/gallery/thumbnails.php?album=249

This picture originally belonged to the album above   (https://coppermine-gallery.com/forum/proxy.php?request=http%3A%2F%2Fwww.adygaunion.us%2Fgallery%2Falbums%2Fuserpics%2F10002%2Fthumb_15_Murat_Dishek%252C-%25CF%25F0%25EE%25F2%25E8%25E2%25EE%25F1%25F2%25EE%25FF%25ED%25E8%25E5-%252C-Resistance-%252C70x80cm%252Coil.jpg&hash=c94688ee418a6dc80c2c6fa9e83d66d76907466b)


Folders used to have many files now empty
http://www.adygaunion.us/gallery/index.php?cat=56
Thumbnail from one of the files in that folder (https://coppermine-gallery.com/forum/proxy.php?request=http%3A%2F%2Fwww.adygaunion.us%2Fgallery%2Falbums%2Fuserpics%2F10005%2Fthumb_s_Crimovym.jpg&hash=14920f488ce67a40cd98a271eaa00c422e145a74)

Many other examples when files are randomly missing, but they are on the server in the same place they were before the glich.

zamirzamir

This is what happened right now 1 minute ago.

I had 4227 files, logged out and now i see

4219 files in 207 albums and 39 categories with 156 comments viewed 170004 times

There is noone logged in, so something weird is happening.

Joachim Müller

Quote from: zamirzamir on December 06, 2006, 08:57:47 AM
Folders used to have many files now empty
http://www.adygaunion.us/gallery/index.php?cat=56
Works fine for me, the album http://www.adygaunion.us/gallery/thumbnails.php?album=139 resides within category 56 and is populated. If the other albums used to populated once and are now empty, you probably have deleted them (maybe by accident). Review your admin settings as well: do you have other people except you who have admin privileges?

Quote from: zamirzamir on December 06, 2006, 09:18:11 AM
This is what happened right now 1 minute ago.

I had 4227 files, logged out and now i see

4219 files in 207 albums and 39 categories with 156 comments viewed 170004 times

There is noone logged in, so something weird is happening.
Expected behaviour - files that are available for the admin or for registered users, but nor for guests are not being taken into account. The file number stats take permissions into account. Subsequently, it's expected behaviour that the number of files differs, depending on your login status. Nothing wrong nor mysterious about this.

I suspect that this is a PEBKAC issue. Please review the docs.

zamirzamir

Quote from: GauGau on December 06, 2006, 09:57:04 AM
Works fine for me, the album http://www.adygaunion.us/gallery/thumbnails.php?album=139 resides within category 56 and is populated. If the other albums used to populated once and are now empty, you probably have deleted them (maybe by accident). Review your admin settings as well: do you have other people except you who have admin privileges?
The problem is that ALL those albums were full with pictures, and pictureas are still on the server. (i used the thumbs for my web site and they are still there.) but for some odd reason the gallery dont see them ((



QuoteExpected behaviour - files that are available for the admin or for registered users, but nor for guests are not being taken into account. The file number stats take permissions into account. Subsequently, it's expected behaviour that the number of files differs, depending on your login status. Nothing wrong nor mysterious about this.

I suspect that this is a PEBKAC issue. Please review the docs.

yeah i figured this one out.....but how did i lose 1200 images after a backup...I dont know.
There are few other people with admin rights, but we have agreement they I'm the only one adjusting the settings and config.

PEBKAC issue....I will read and see if thats the one. Thanks.


Can someone explain how to use the cpgmassimport plugin ? and not mess up what i have in the gallery right now...

zamirzamir

Tryed to search for PEBKAC in documentation....nothing.  ???

Joachim Müller

Quote from: zamirzamir on December 07, 2006, 07:45:34 AM
yeah i figured this one out.....but how did i lose 1200 images after a backup...
Maybe you have accidentally ticked the drop option when performing the backup.

Quote from: zamirzamir on December 07, 2006, 07:45:34 AM
There are few other people with admin rights, but we have agreement they I'm the only one adjusting the settings and config.
They might have done this by accident.

Look: there is no way how we could determine what went actually wrong. It looks like you have made a mistake, but there's a possibilty that your site has been hacked (which I doubt though, as a malevolent hacker wouldn't just have deleted some images). Another possible option is that your webhost had issues with the database and restored an older backup that didn't contain the entries of the missing pics. If you need to figure out what went wrong, hire a computer forensics expert to review your server logs etc.
After all, it doesn't matter what actually went wrong - if the entries in the database are missing, you have to restore them or re-create them. There's little other advice we could give. Don't expect us to cure issues that we haven't caused in the first place - we're open source developers, not magicians nor detectives.


Quote from: zamirzamir on December 07, 2006, 07:45:34 AM
Can someone explain how to use the cpgmassimport plugin ? and not mess up what i have in the gallery right now...
Read the corresponding thread.



Quote from: zamirzamir on December 07, 2006, 09:30:53 AM
Tryed to search for PEBKAC in documentation....nothing.  ???
Not in the documentation - see http://en.wikipedia.org/wiki/Pebkac