How do you open https url in Python?
import urllib2
url = "https://user:[email protected]/path/
f = urllib2.urlopen(url)
print f.read()
gives:
httplib.InvalidURL: nonnumeric port: '[email protected]'
-
THe way to read https URL's in Python is to actually search stackoverflow before posting the same question that's already been asked. Here's the search results: stackoverflow.com/search?q=%5Bpython%5D+httpsS.Lott– S.Lott2009-12-15 12:07:49 +00:00Commented Dec 15, 2009 at 12:07
Add a comment
|
4 Answers
This has never failed me
import urllib2, base64
username = 'foo'
password = 'bar'
auth_encoded = base64.encodestring('%s:%s' % (username, password))[:-1]
req = urllib2.Request('https://somewebsite.com')
req.add_header('Authorization', 'Basic %s' % auth_encoded)
try:
response = urllib2.urlopen(req)
except urllib2.HTTPError, http_e:
# etc...
pass
1 Comment
jfs
request.add_header('Authorization', b'Basic ' + base64.b64encode(username + b':' + password))Please read about the urllib2 password manager and the basic authentication handler as well as the digest authentication handler.
http://docs.python.org/library/urllib2.html#abstractbasicauthhandler-objects
http://docs.python.org/library/urllib2.html#httpdigestauthhandler-objects
Your urllib2 script must actually provide enough information to do HTTP authentication. Usernames, Passwords, Domains, etc.
Comments
If you want to pass username and password information to urllib2 you'll need to use an HTTPBasicAuthHandler.
Comments
You cannot pass credentials to urllib2.open like that. In your case, user is interpreted as the domain name, while [email protected] is interpreted as the port number.
