Is there any Python HTTP library that helps to imitate one of popular web-browser and has HTTPS support? I would like to define the order of HTTP headers, the presence of each exact header, the order of cookies values - everything that relates to "fingerprint" of a browser. We need that to test specific web server.
1
-
For httplib, if you don't add headers, will the header contains anything you don't want?nhahtdh– nhahtdh2012-09-17 11:26:57 +00:00Commented Sep 17, 2012 at 11:26
Add a comment
|
2 Answers
httplib.request will take an OrderedDict for headers. Some headers will be added automatically for protocol compliance, which will be left out if you specify them in your supplied headers.
Take a look at the putheader and _send_request methods, which you could override if their behaviour didn't suit your purposes.
>>> import httplib
>>> from collections import OrderedDict
>>> h = OrderedDict(('X-A','a'),('X-B','b'),('X-C','c'))
>>> c = httplib.HTTPConnection('localhost')
>>> c.set_debuglevel(1)
>>> r = c.request('GET','/','',h)
send: 'GET / HTTP/1.1\r\nHost: localhost\r\nAccept-Encoding: identity\r\nX-A: a\r\nX-B: b\r\nX-C: c\r\n\r\n'
1 Comment
MattH
httplib also has some HTTPS support.Check out Requests which is very easy to work with and has all you need. Alternatively you can drive web browser itself from Python using Selenium
answered Sep 17, 2012 at 12:43
Piotr Dobrogost
42.7k47 gold badges243 silver badges379 bronze badges
1 Comment
nhahtdh
One of your link seems to be from your local network. Well, at least I cannot access.