coppermine-gallery.com/forum

Support => cpg1.3.x Support => Older/other versions => cpg1.3 Upload => Topic started by: LazyCat on June 21, 2005, 06:50:21 PM

Title: Huge amount of files for batch-add
Post by: LazyCat on June 21, 2005, 06:50:21 PM
I faced with problem - need to add about 40.000 jpg's to fresh installed CPG 1.3.3
Using dedicated server, 4 Xeon processors, 6Gb Memory but still can't batch add even more then 5000 pics.

Is there any suggestions?
Title: Re: Huge amount of files for batch-add
Post by: OmegaGOD on June 22, 2005, 04:35:38 AM
To my knowledge there is no limit CPG has on batch-adding of images. With the server spec you gave you should have no problem; however, if you are still having problems, I would suggest just batch adding in batches. If you can do 5000 at a time then I would suggest breaking the batch-add into 5000 images at a time.

Hope this helps
Title: Re: Huge amount of files for batch-add
Post by: Tranz on June 22, 2005, 06:00:15 AM
There is a script by Nibbler that could help. I think it is called timer.php
Title: Re: Huge amount of files for batch-add
Post by: steverobbins on June 22, 2005, 01:48:57 PM
Hi there,

I read somewhere on the web that there is a limit to the amount of files that can be read in a single directory.  It's something to do with the server config - to stop D-O-S attacks, like listing the contents of a directory over and over again that soaks up server cycles.  I hit a 2000 file limit on my server.

Perhaps this might be something to do with it, perhaps not.  Try searching Google for FTP config.

Regards
Steve.
Title: Re: Huge amount of files for batch-add
Post by: Tranz on June 22, 2005, 04:40:38 PM
My webhost has that limit, too.
Title: Re: Huge amount of files for batch-add
Post by: OmegaGOD on June 23, 2005, 03:56:10 AM
Interesting... I never considered that web-hosts would limit access in that way. I mean it makes sense to if you are using a shared server with shared resources and you want to protect against D.O.S. attacks.

I wonder if my web-host has this policy in place too?