coppermine-gallery.com/forum

Support => cpg1.4 plugins => cpg1.4.x Support => Older/other versions => cpg1.4 JUpload by etienne_sf => Topic started by: emperoradz on October 09, 2009, 01:05:33 AM

Title: Uploading Big Photos in Large Quantities
Post by: emperoradz on October 09, 2009, 01:05:33 AM
We are running Coppermine + JUpload (latest version) on our Yearbook Server.

Here are our settings:
Max size for uploaded files (KB): 10000000000000
Max width or height for uploaded pictures/videos (pixels): 2048000
maxChunkSize: 2000
maxFileSize: 50000
maxNonTransformedPictureSize: 50000
pictureCompressionQuality: 1

We upload all kinds of photos (7MP, 8MP, 12MP, etc). The largest we usually upload is 12MP (7000-10000KB).
We want NO resizing and modification. Just plain uploads.

Now when we try to upload 100 or so 12MP files, it's fine. But when we try uploading 500 or so, after 127 it starts complaining that the files are too big, and we need to click OK repeatedly for the 400 remaining files.

Any way to turn off ALL warnings, turn of resizing of any kind, and let any picture through unblemished.

Also, when is metadata preservation coming....
Title: Re: Uploading Big Photos in Large Quantities
Post by: Joachim Müller on October 09, 2009, 07:52:25 AM
Quote from: emperoradz on October 09, 2009, 01:05:33 AM
We are running Coppermine + JUpload (latest version) on our Yearbook Server.
JUpload is a plugin that is not part of coppermine itself. It only get's supported within the very sub-board "cpg1.4 JUpload by etienne_sf (http://forum.coppermine-gallery.net/index.php/board,100.0.html)"

Quote from: emperoradz on October 09, 2009, 01:05:33 AMMax size for uploaded files (KB): 10000000000000
Use settings that make sense: 10,000 TB is just plain stupid and might cause issues.
Quote from: emperoradz on October 09, 2009, 01:05:33 AMMax width or height for uploaded pictures/videos (pixels): 2048000
That's of course silly as well.
Quote from: emperoradz on October 09, 2009, 01:05:33 AMmaxChunkSize: 2000
maxFileSize: 50000
maxNonTransformedPictureSize: 50000
pictureCompressionQuality: 1
Those are JUpload settings. I have no idea of their impact.

Quote from: emperoradz on October 09, 2009, 01:05:33 AMWe want NO resizing and modification. Just plain uploads.
You don't even want thumbnails to be created? OK, that's an unusual setup.

Quote from: emperoradz on October 09, 2009, 01:05:33 AMNow when we try to upload 100 or so 12MP files, it's fine. But when we try uploading 500 or so, after 127 it starts complaining that the files are too big, and we need to click OK repeatedly for the 400 remaining files.
Happens when? Using JUpload or using coppermine's batch-add?

Quote from: emperoradz on October 09, 2009, 01:05:33 AMAny way to turn off ALL warnings
What warnings? Batch-add is an admin only feature. The admin should be able to live with some warnings.
Quote from: emperoradz on October 09, 2009, 01:05:33 AMturn of resizing of any kind
Sure: set the max pixel size for thumbnails and intermediates to the same value you have set your max resolution to.

Quote from: emperoradz on October 09, 2009, 01:05:33 AMAlso, when is metadata preservation coming....
As far as Coppermine is concerned: as soon as the image libraries that Coppermine can use (GD or ImageMagick) will support meta tag preservation we'll add that feature to coppermine as well. We can't add features to coppermine that the underlying architecture don't have.

We have a strict "one question per thread (http://forum.coppermine-gallery.net/index.php/topic,55415.msg270618.html#msg270618)" policy that you agreed to respect when signing up. Another policy says that it's absolutely mandatory to post a link (http://forum.coppermine-gallery.net/index.php/topic,55415.msg270616.html#msg270616) to your gallery in each thread. And yet another policy says that you must have read the docs (http://forum.coppermine-gallery.net/index.php/topic,55415.msg270608.html#msg270608) before being allowed to post on the support board. If you have issues with uploading (and as far as I am concerned batch-add is an uploading method just as well), do exactly as suggested in the docs (http://coppermine-gallery.net/demo/cpg14x/docs/index.htm), section "asking for support on upload issues (http://coppermine-gallery.net/demo/cpg14x/docs/index.htm#upload_support)".

If you have posted this in error on the upload sub-board and where looking for JUpload support only, say so in your reply, so a moderator can move your thread accordingly. Most of the recommendations posted above apply nevertheless though, as JUpload is using the server-side of coppermine.
Title: Re: Uploading Big Photos in Large Quantities
Post by: emperoradz on October 13, 2009, 10:41:30 PM
Ah looks like I posted it in the wrong place. Can you please move this to JUpload?

Quote
Use settings that make sense: 10,000 TB is just plain stupid and might cause issues.That's of course silly as well.Those are JUpload settings. I have no idea of their impact.
Meant to be no limit, wasn't sure how to do it so just put 10 PB

Quote
You don't even want thumbnails to be created? OK, that's an unusual setup.
We do, we just don't want the original file to be edited.

Quote
Happens when? Using JUpload or using coppermine's batch-add?
JUpload, we only use JUpload

Quote
What warnings? Batch-add is an admin only feature. The admin should be able to live with some warnings.Sure: set the max pixel size for thumbnails and intermediates to the same value you have set your max resolution to.
Says size is too big so it won't be resized (JUpload warning)

Quote
We have a strict "one question per thread (http://forum.coppermine-gallery.net/index.php/topic,55415.msg270618.html#msg270618)" policy that you agreed to respect when signing up. Another policy says that it's absolutely mandatory to post a link (http://forum.coppermine-gallery.net/index.php/topic,55415.msg270616.html#msg270616) to your gallery in each thread. And yet another policy says that you must have read the docs (http://forum.coppermine-gallery.net/index.php/topic,55415.msg270608.html#msg270608) before being allowed to post on the support board. If you have issues with uploading (and as far as I am concerned batch-add is an uploading method just as well), do exactly as suggested in the docs (http://coppermine-gallery.net/demo/cpg14x/docs/index.htm), section "asking for support on upload issues (http://coppermine-gallery.net/demo/cpg14x/docs/index.htm#upload_support)".
It's being a private network

Quote
If you have posted this in error on the upload sub-board and where looking for JUpload support only, say so in your reply, so a moderator can move your thread accordingly. Most of the recommendations posted above apply nevertheless though, as JUpload is using the server-side of coppermine.
yup sorry. Please move it to JUpload board
Title: Re: Uploading Big Photos in Large Quantities
Post by: Joachim Müller on October 14, 2009, 08:27:16 AM
Quote from: emperoradz on October 13, 2009, 10:41:30 PMIt's being a private network
Then there can only be generic advice: make sure that regular http uploads work as expected first before uploading with JUpload. Can't help you with JUpload issues, as I don't know/understand/use it, so I'm out of this thread. Bye.

Quote from: emperoradz on October 13, 2009, 10:41:30 PMIt's being a private network
Then there can only be generic yup sorry. Please move it to JUpload board[/quote]Phill did as you suggested.
Title: Re: Uploading Big Photos in Large Quantities
Post by: etienne_sf on October 16, 2009, 04:37:57 PM
Hi,

  I missed this message as I (apparently) get no alarm in my mail box, when a message is moved. Sorry for that.

Here are my answer, about JUpload :

Quote from: emperoradz on October 09, 2009, 01:05:33 AM
We are running Coppermine + JUpload (latest version) on our Yearbook Server.

Here are our settings:
Max size for uploaded files (KB): 10000000000000
Max width or height for uploaded pictures/videos (pixels): 2048000
maxChunkSize: 2000
maxFileSize: 50000
maxNonTransformedPictureSize: 50000
pictureCompressionQuality: 1

We upload all kinds of photos (7MP, 8MP, 12MP, etc). The largest we usually upload is 12MP (7000-10000KB).
We want NO resizing and modification. Just plain uploads.

Now when we try to upload 100 or so 12MP files, it's fine. But when we try uploading 500 or so, after 127 it starts complaining that the files are too big, and we need to click OK repeatedly for the 400 remaining files.

Can you put here the JUpload debug output ?

I never managed so many such big files...

Quote from: emperoradz on October 09, 2009, 01:05:33 AM
Any way to turn off ALL warnings, turn of resizing of any kind, and let any picture through unblemished.

I don't know exactly about he Warnings.

To turn off resizing:
- Keep the parameter you've choosen
- Put in maxFileSize a bigger value, like you did for 'Max size for uploaded file'


Quote from: emperoradz on October 09, 2009, 01:05:33 AM
Also, when is metadata preservation coming....

  You can preserve metadata. Go to the JUpload configuration page (parameter pictureTransmitMetadata). But you'll have to test if it's ok, with your configuration. With (apparently) recent camera, preserving leads to 'strange' colors. See one of the three head messages in this list (and vote for its correction ! see explanation there).


Etienne

Title: Re: Uploading Big Photos in Large Quantities
Post by: adzempire on December 10, 2009, 09:15:35 PM
USER:
------------------
Array
(
    [ID] => f9da9978139d0594aa491a6d05f594d0
    [am] => 1
    [lang] => english
    [lap] => 3
    [liv] => Array
        (
        )

    [search] => Array
        (
            [search] => speech
            [album] => search
            [plugin_search_album] => true
            [title] => on
            [newer_than] =>
            [caption] => on
            [older_than] =>
            [keywords] => on
            [type] => OR
            [album_title] => on
            [album_description] => on
            [params] => Array
                (
                    [title] => on
                    [caption] => on
                    [keywords] => on
                )

        )

)

==========================
USER DATA:
------------------
Array
(
    [user_id] => 61
    [user_name] => Thorp
    [groups] => Array
        (
           
Title: Re: Uploading Big Photos in Large Quantities
Post by: etienne_sf on December 11, 2009, 09:01:00 AM
adzempire,

  What's this message about ???

Is this linked to this (old) thread ?

Etienne
Title: Re: Uploading Big Photos in Large Quantities
Post by: emperoradz on December 11, 2009, 05:57:34 PM
yup it is

The big photo error when uploading > 100ish files
Title: Re: Uploading Big Photos in Large Quantities
Post by: etienne_sf on December 14, 2009, 11:42:50 AM
Hi,

  Ok. So what I need is the JUpload debug. Can you read the doc here, for an howto on this point :
http://forum.coppermine-gallery.net/index.php/topic,53168.0.html (http://forum.coppermine-gallery.net/index.php/topic,53168.0.html)

Etienne