How to get data from a URL with Python

Question

How do I get data from a URL?

URL:

http:\\localhost\?id=1&q=W&random_id=12002H#@&&up=down

Then I want to store it in a dictionary:

data = {
    "id": "1",
    "q": "W",
    "random_id": "12022H#@&",
    "up": "down"
}

Your URL should be encoded to work with standard html ? http:\\localhost\?id=1&q=W&random_id=12002H%23%40%26&up=down — pyOliv
– pyOliv, Commented May 20, 2020 at 4:25

Peter Mortensen · Accepted Answer · 2021-01-03 22:18:23Z

1

As mentioned in my comment, the given URL does not look valid. I've used the valid encoded one : http:\\localhost\?id=1&q=W&random_id=12002H%23%40%26&up=down. Then you can parse it using urllib:

from urllib import parse
url = 'http:\\localhost\?id=1&q=W&random_id=12002H%23%40%26&up=down'

query = parse.urlsplit(url).query
print(query)
print(parse.parse_qsl(query))
data = dict(parse.parse_qsl(query))
print(data)

Output:

id=1&q=W&random_id=12002H%23%40%26&up=down
[('id', '1'), ('q', 'W'), ('random_id', '12002H#@&'), ('up', 'down')]
{'id': '1', 'q': 'W', 'random_id': '12002H#@&', 'up': 'down'}

edited Jan 3, 2021 at 22:18

Peter Mortensen

31.4k22 gold badges110 silver badges134 bronze badges

answered May 20, 2020 at 4:34

pyOliv

1,3232 gold badges8 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to get data from a URL with Python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related