Upload file with multipart POST request using Apache Http Async Client

Question

I am trying to upload a 260k image file as part of multipart form using Apache HttpAsyncClient library.

I create my form this way:

val multipartEntityBuilder = new MultipartEntityBuilder
multipartEntityBuilder.addBinaryBody("file", file)
val multipartEntity = multipartEntityBuilder.build()

And then I receive a ContentTooLongException when performing request basically because of this line in the library's source code: https://github.com/apache/httpclient/blob/4.5.3/httpmime/src/main/java/org/apache/http/entity/mime/MultipartFormEntity.java#L102

I searched a lot, but didn't find any explanation why this limitation for contentLength is present in code. Maybe someone could explain it? And my second question: what is the proper way to make an upload request for a file larger than 25 kb?

Thanks!

Updated link: github.com/apache/httpcomponents-client/blob/master/httpclient5/… And explanation: issues.apache.org/jira/browse/HTTPASYNC-163 — Raipe
– Raipe, Commented May 26, 2021 at 6:43
And the suggestion is to indeed use the BufferedHttpEntity: One should either build a custom `HttpAsyncRequestProducer` capable of producing multipart content asynchronously or wrap `MultipartFormEntity` with `BufferedHttpEntity` if they do not mind buffering multipart content in memory prior to writing it out to an asynchronous I/O channel. — Raipe
– Raipe, Commented May 26, 2021 at 6:44

Andrey · Accepted Answer · 2017-03-14 08:14:36Z

10

Found the solution: create inputStream over file and wrap the multipart entity with BufferedHttpEntity and then pass this buffered entity to request:

val multipartEntityBuilder = MultipartEntityBuilder.create()
multipartEntityBuilder.addBinaryBody("file", new FileInputStream(file), ContentType.DEFAULT_BINARY, name)
val multipartEntity = multipartEntityBuilder.build()
val entity = new BufferedHttpEntity(multipartEntity)

answered Mar 14, 2017 at 8:14

Andrey

3312 silver badges10 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Alessandro Valentino Over a year ago

This loads the whole file in memory so uploading a 50gb file results in an out of memory error, any way to avoid it?

Collectives™ on Stack Overflow

Upload file with multipart POST request using Apache Http Async Client

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related