python http client module error / inconsistent

Question

I'm getting the following output

301 Moved Permanently --- when using http.client

200 --- when using requests

URL handling "https://i.sstatic.net/dJpHN.jpg" passed as arg through command

What I expect is give me 200 status ok response.

This is the body

  if scheme == 'http':
       print('Ruuning in the http')
       conn = http.client.HTTPConnection("www.i.imgur.com")
       conn.request("GET", urlparse(url).path)
       conn_resp = conn.getresponse()
       body = conn_resp.read()
       print(conn_resp.status, conn_resp.reason, body)

When using the requests

  headers = {'User-Agent': 'Mozilla/5.0 Chrome/54.0.2840.71 Safari/537.36'}
  response = requests.get(url, allow_redirects=False)
  print(response.status_code)

What do you want to do?

lapinkoira
– lapinkoira

2017-09-22 08:07:42 +00:00
Commented Sep 22, 2017 at 8:07 — lapinkoira
– lapinkoira, Commented Sep 22, 2017 at 8:07
requests follows redirects by default.

Niklas R
– Niklas R

2017-09-22 08:09:49 +00:00
Commented Sep 22, 2017 at 8:09 — Niklas R
– Niklas R, Commented Sep 22, 2017 at 8:09

Anuj · Accepted Answer · 2017-09-24 07:53:31Z

2

You are trying to hit imgur over http, but imgur redirects all its request to process over https.

Due to this redirect the issue is occurring.

http module doesnt inherently handle the redirects you need to handle the redirects, where as requests module handles these redirects by itself.

edited Sep 24, 2017 at 7:53

answered Sep 22, 2017 at 8:23

Anuj

1,01411 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

holdenweb · Accepted Answer · 2017-09-22 08:11:01Z

2

The documentation on the http module includes in its first sentence "It is normally not used directly." Unlike requests it doesn't action the 301 response and follow the redirection in the headers. It instead returns the 301, which you would have to process yourself.

answered Sep 22, 2017 at 8:11

holdenweb

37.8k7 gold badges62 silver badges80 bronze badges

Collectives™ on Stack Overflow

python http client module error / inconsistent

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related