Merge a string to URL in python

Question

I have to concatenate a hardcoded path of "string" type to a URL to have a result which is a URL.

url (which doesn't end with "/") + "/path/to/file/" = new_url

I tried concatenation using URL join and also tried used simple string concat but the result is not a URL which can be reached. (not that the URL address is invalid )

mirror_url = "http://amazonlinux.us-east- 
2.amazonaws.com/2/core/latest/x86_64/mirror.list"

response = requests.get(mirror_url)
contents_in_url = response.content


## returns a URL as shown below but of string type which cannot be 
##concatenated to another string type which could be requested as a valid 
##URL.
'http://amazonlinux.us-east- 2.amazonaws.com/2/core/2.0/x86_64/8cf736cd3252ada92b21e91b8c2a324d05b12ad6ca293a14a6ab7a82326aec43'

path_to_add_to_url = "/repodata/primary.sqlite.gz"

final_url = contents_in_url + path_to_add_to_url

Desired Result:

Without omitting any path to that file.

final_url = "http://amazonlinux.us-west-2.amazonaws.com/2/core/2.0/x86_64/8cf736cd3252ada92b21e91b8c2a324d05b12ad6ca293a14a6ab7a82326aec43/repodata/primary.sqlite.gz"

So what is the result you are getting? Have you looked at stackoverflow.com/questions/1793261/… ? — intotecho
– intotecho, Commented Jul 19, 2019 at 4:51
@intotecho Yeah,but in my case I have to stick to "requests" library ,cant use 'urllib'. — prash
– prash, Commented Jul 19, 2019 at 12:39

Andrej Kesely · Accepted Answer · 2019-07-19 17:00:52Z

0

You need to get contents of the first response by response.text method, not response.content:

import requests

mirror_url = "http://amazonlinux.us-east-2.amazonaws.com/2/core/latest/x86_64/mirror.list"

response = requests.get(mirror_url)
contents_in_url = response.text.strip()

path_to_add_to_url = "/repodata/primary.sqlite.gz"

response = requests.get(contents_in_url + path_to_add_to_url)

with open('primary.sqlite.gz', 'wb') as f_out:
    f_out.write(response.content)

print('Downloading done.')

edited Jul 19, 2019 at 17:00

answered Jul 19, 2019 at 5:05

Andrej Kesely

196k15 gold badges60 silver badges105 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

prash Over a year ago

the 'mirror_url' in the question when requested gives a string which when concatenated with '/repodata/primary.sqlite.gz' returns a string ,which can't be requested to get response 200.

prash Over a year ago

Kesely Thanks, but unfortunately that doesn't seem to work in my case as the 'mirror_url' also seems to have a URL in its contents. Strangely so it doesn't work.

prash Over a year ago

The below code doesn't seem to work. ` import requests url = "amazonlinux.us-east- 2.amazonaws.com/2/core/latest/x86_64/mirror.list" response = requests.get(url) text = response.content repo_path = "/repodata/primary.sqlite.gz" res = requests.get(text + repo_path) print res `

Andrej Kesely Over a year ago

@prash Updated my answer

Collectives™ on Stack Overflow

Merge a string to URL in python

1 Answer 1

4 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related