Downloading compressed content over HTTP using Python

Question

How do I take advantage of HTTP 1.1's compression when downloading web pages using Python?

I am currently using the built-in urllib module for downloading web content. Reading through the documentation I couldn't find any information that is indeed using compression.

Is it already built-in into urllib or is there another library that I can use?

Nick Presta · Accepted Answer · 2009-08-22 17:39:59Z

6

httplib2 supports 'deflate' and 'gzip' compression.

Example

import httplib2
h = httplib2.Http(".cache")
resp, content = h.request("http://example.org/", "GET")

The content is decompressed as necessary.

answered Aug 22, 2009 at 17:39

Nick Presta

28.8k6 gold badges61 silver badges76 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Downloading compressed content over HTTP using Python

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related