Text only | Text with Images

coppermine-gallery.com/forum

Support => Older/other versions => cpg1.2 Standalone Support => Topic started by: pierrela on June 07, 2004, 11:57:46 PM

Title: Too many convert.exe at the same time use too much memory
Post by: pierrela on June 07, 2004, 11:57:46 PM
Hi,

I try to add multiple pictures at once (I put them in the album before). Thepictures are quite heavy, 1.5 Mo each.
It's working but CPG is launching several instances of convert at the same time, about 8. It's using so much memory my computer performances are runnig down.

I would like to know if there is a way to limit CPG so that it launch an instance of convert (Imagemagick) anc wait until it has finish before sending another one.

Thanks in advance.

Title: Re: Too many convert.exe at the same time use too much memory
Post by: Joachim Müller on June 08, 2004, 08:12:22 AM
not possible at the moment, add less pics in one go, or use GD.

GauGau
Title: Re: Too many convert.exe at the same time use too much memory
Post by: dleach on September 15, 2005, 12:53:34 AM
I'm also somewhat frustrated with the performance of the batch upload. I have several hundred pictures I'm trying to upload to the database and I'm finding that I have to do it one at a time. If I use GD2 then I find that my server will hang. If I use Imagemagick then if I do more then a couple at a time it just kills the machine.

In my case, I have direct access to the server. It isn't the fastest of machines, but I'm curious how these sites handle such large numbers of uploads? I've also seen a number of threads in this forum complaining about this issue but there doesn't seem to be any answers nor does there seem to be a plan on how to handle this.

David
Title: Re: Too many convert.exe at the same time use too much memory
Post by: Nibbler on September 15, 2005, 01:03:47 AM
Batch uploading is a resource intensive process, you can't really get around that. You might like to check this mod (http://forum.coppermine-gallery.net/index.php?topic=13949.0) which processes pics in serial instead of in parallel.
Title: Re: Too many convert.exe at the same time use too much memory
Post by: dleach on October 04, 2005, 06:19:53 AM
I think I found a better way around this... and I don't have to change any code. I use Photoshop CS to batch convert my files to the appropriate thumb_<name> and normal_<name> files. Then I upload all the files to my server. When I do a batch add the code is already in place (in add_picture()) to know that the thumb and normal files are already there and that it doesn't have to call resize_image() to create them.

This allows fairly quick batch uploads of files. The only problem I've seen is that it may take me several attempts to upload all my files (not sure why). But in the end it is much quicker then uploading a single image and letting the system convert the file into the thumb and normal images.

Note that this works with the 1.4.1 version of Coppermine (the one I'm currently using).

David
Title: Re: Too many convert.exe at the same time use too much memory
Post by: Joachim Müller on October 05, 2005, 12:42:02 AM
Quote from: dleach on October 04, 2005, 06:19:53 AMNote that this works with the 1.4.1 version of Coppermine (the one I'm currently using).
Works in all coppermine versions this way.
Title: Re: Too many convert.exe at the same time use too much memory
Post by: dleach on October 05, 2005, 07:52:31 PM
Yeah... I figured that out. There are a number of performance related threads in this forum of people looking for a way around this performance problem. Seems that this is one answer to their problems and could be something highlighted in some documentation.... just a suggestion.
Text only | Text with Images