python requests module iteration

Question

I was doing a coding challenge and noticed something weird with how arrays worked with modules (or more likely it's my own error).

pages = [*list of 5 webpages*]
final = []

for i in range(0,4):
    page = requests.get(pages[i])
    piece = page.text
    final.append(piece)

print(''.join(final))

This code only joins 4 of the 5 webpages. Changing the range to 0,5 or len(pages) solves the problem. I was under the impression that 0,4 would include all the webpages in my list (5 of them) since indexing starts at 0.

Why are you iterating over indices? Just iterate over the pages directly? for page in pages: page = requests.get(page) — cs95
– cs95, Commented Feb 9, 2020 at 4:17
Python range doesn't include the "end" value, so range(x, y) means x, x+1, x+2, ..., y-2, y-1. — iBug
– iBug, Commented Feb 9, 2020 at 4:18

cs95 · Accepted Answer · 2020-02-09 04:33:51Z

1

The following code is pythonic and more robust in a sense that it does not depend on the number of pages:

pages = [*list of 5 webpages*]
final = [requests.get(page).text for page in pages]
print(''.join(final))

edited Feb 9, 2020 at 4:33

cs95

406k106 gold badges744 silver badges797 bronze badges

answered Feb 9, 2020 at 4:29

DYZ

57.3k10 gold badges73 silver badges101 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

python requests module iteration

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related