Python urlib and authentication

Question

I need help authenticating logging into this site using urllib. I am using python 3, but I'm willing to revert to 2.x. This is what I have sofar (basically from the documentation), it gives not errors, but its not logging in.

file =open("loggedinsource.html",'wb')

# Create an OpenerDirector with support for Basic HTTP Authentication...
auth_handler = urllib.request.HTTPBasicAuthHandler()
auth_handler.add_password(realm='kalahari.net',uri='https://www.kalahari.net/profile/pipeline/signin.aspx?',user='myuser',passwd='mypass')

opener = urllib.request.build_opener(auth_handler)

# ...and install it globally so it can be used with urlopen.
urllib.request.install_opener(opener)
f=urllib.request.urlopen('https://www.kalahari.net/profile/pipeline/signin.aspx?')

page=f.read()
file.write(page);
file.close()

I have been struggling with this for ages, any help please.

We can help with code questions, but not with "struggling". Do you even know that you need basic HTTP auth? Most websites use sessions/cookies ... — Jochen Ritzel
– Jochen Ritzel, Commented Feb 28, 2011 at 21:20
Just tried visiting the URL in the OPs code, and it's using a form to capture user/pass, not HTTP basic auth. — bgporter
– bgporter, Commented Feb 28, 2011 at 21:48

Marc Abramowitz · Accepted Answer · 2011-03-01 00:18:59Z

1

The site you are trying to log into is not using HTTP basic auth; it is using a regular HTML form.

If you want to log into something like this, you probably want to look at something like mechanize

answered Mar 1, 2011 at 0:18

Marc Abramowitz

3,6354 gold badges26 silver badges30 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Vort3x Over a year ago

Thanks, I had no idea about the need for HTTP Auth or not, pretty new to python and web programming. thanks I will look into mechanize and I heard ClientForm can be useful too.

Collectives™ on Stack Overflow

Python urlib and authentication

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related