Python Requests module behaving different in a for loop

Question

I'm trying to do a script which reads a line (URL) in a text file, checks its code_status and then print to the user, however, when using for loop it gives wrong code_status while testing with one URL in the request.get(url) gives the right one.

Problematic code

import requests
with open('test2.txt', 'r+') as arquivo:
        for linhas in arquivo:
                url = requests.get(linhas)
                print url.status_code

Achieves the right code.

import requests         
url = requests.get(URL)
print url.status_code

You guys can test both the txt file and single URL with the following URL: https://api.github.com/user

What am I doing wrong?

Possibly the text file has a newline character at the end and the URL is thus wrong. — Paulo Almeida
– Paulo Almeida, Commented Sep 5, 2015 at 16:53
@PauloAlmeida I've noticed that when the urls are printed in the terminal but the text file are well orderly — Milbol
– Milbol, Commented Sep 5, 2015 at 16:56
@Milbol when you read from file lin-by-line, you end up with a new line at the end of each entry, you ahve to strip it. see my answer for the fix. — Kamyar Ghasemlou
– Kamyar Ghasemlou, Commented Sep 5, 2015 at 16:58

Kamyar Ghasemlou · Accepted Answer · 2015-09-05 17:04:44Z

2

Most probably your problem is because of the \n character at the end of each line. this should fix it:

import requests
with open('test2.txt', 'r+') as arquivo:
        for linhas in arquivo:
                url = requests.get(linhas.strip())
                print url.status_code

edited Sep 5, 2015 at 17:04

answered Sep 5, 2015 at 16:55

Kamyar Ghasemlou

8592 gold badges9 silver badges24 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python Requests module behaving different in a for loop

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related