chunked HTTP upload with Python

Question

I've developed a REST api to handle file uploads. Since the system handles large files the api handles upload with chunked encoding. The api work fine with JQuery's file upload plugin so there are no problems on the server side.

I'm currently working with a python script to do some batch processing with a large amount of big files. However i can't find any example, code snippets or guides on how to do a chunked upload with python. I looked up urllib2, httplib but i can't get it to work. I've also digged into curl but without any luck.

André Cruz · Accepted Answer · 2012-08-06 10:35:11Z

0

You can use Pycurl as seen in the example. If you omit the setting if pycurl.INFILESIZE, Pycurl will perform a chunked upload since it does not know the size of the data to upload.

answered Aug 6, 2012 at 10:35

André Cruz

5101 gold badge5 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Community · Accepted Answer · 2017-05-23 10:09:21Z

0

You need to upload the file as a multi-part form data. Can be accomplished in curl by setting the encoding type to "multipart/form-data". Similar upload can be accomplished using something like what is mentioned here - Using MultipartPostHandler to POST form-data with Python

edited May 23, 2017 at 10:09

CommunityBot

11 silver badge

answered Jun 27, 2012 at 18:54

Pratik Mandrekar

9,5764 gold badges48 silver badges67 bronze badges

Collectives™ on Stack Overflow

chunked HTTP upload with Python

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related