Python Requests Library can't read URL

Question

My code is:

import requests

company_name_url('http://www.forbes.com/global2000/list/#page:3_sort:2_direction:asc_search:_filter:All%20industries_filter:All%20countries_filter:All%20states')

r = requests.get(company_name_url)

But it only open page 1 even when I change the page number in the url.

The page is running some javascript. See this question.

Open AI - Opting Out
– Open AI - Opting Out

2014-12-07 21:54:42 +00:00
Commented Dec 7, 2014 at 21:54 — Open AI - Opting Out
– Open AI - Opting Out, Commented Dec 7, 2014 at 21:54

Nwilson · Accepted Answer · 2014-12-07 23:07:57Z

1

It looks like the issue is that the page first loads up with information before the third page query is made to the system (and the information displayed on the page is then updated as opposed to it loading the third page immediately with information). I'm not sure how to fix this with requests, but it looks like that is the source of your problem.

answered Dec 7, 2014 at 23:07

Nwilson

12110 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python Requests Library can't read URL

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related