URL encoding in python

Question

Is there a simple method I'm missing in urllib or other library for this task? URL encoding replaces unsafe ASCII characters with a "%" followed by two hexadecimal digits.

Here's an example of an input and my expected output:

Mozilla/5.0 (Linux; U; Android 4.0; xx-xx; Galaxy Nexus Build/IFL10C) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30

Mozilla%2F5.0+%28Linux%3B+U%3B+Android+4.0%3B+xx-xx%3B+Galaxy+Nexus+Build%2FIFL10C%29+AppleWebKit%2F534.30+%28KHTML%2C+like+Gecko%29+Version%2F4.0+Mobile+Safari%2F534.30

qiao · Accepted Answer · 2018-07-25 10:05:35Z

53

For Python 2.x, use urllib.quote

Replace special characters in string using the %xx escape. Letters, digits, and the characters '_.-' are never quoted. By default, this function is intended for quoting the path section of the URL. The optional safe parameter specifies additional characters that should not be quoted — its default value is '/'.

example:

In [1]: import urllib

In [2]: urllib.quote('%')
Out[2]: '%25'

EDIT:

In your case, in order to replace space by plus signs, you may use urllib.quote_plus

example:

In [4]: urllib.quote_plus('a b')
Out[4]: 'a+b'

For Python 3.x, use quote

>>> import urllib
>>> a = "asdas#@das"
>>> urllib.parse.quote(a)
'asdas%23%40das'

and for string with space use quote_plus

>>> import urllib
>>> a = "as da& s#@das"
>>> urllib.parse.quote_plus(a)
'as+da%26+s%23%40das'

edited Jul 25, 2018 at 10:05

user8554766

answered Jan 18, 2012 at 6:07

qiao

18.3k7 gold badges60 silver badges46 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Avaris Over a year ago

or urllib.quote_plus, since OP wants + instead of %20.

Dan D. Over a year ago

but to get what the OP asks for, use urllib.quote_plus.

user8554766 Over a year ago

I believe, for Python 3.*, you should do import urllib.parse ... urllib.parse.quote ... or from urllib import parse ... parse.quote ... rather than import urllib ... urllib.parse.quote ..., which will result in AttributeError: module 'urllib' has no attribute 'parse', kind of similar to imports in werkzeug. Tested on Python 3.6.1.

Community · Accepted Answer · 2017-05-23 11:47:23Z

3

Keep in mind that both urllib.quote and urllib.quote_plus throw an error if an input is a unicode string:

s = u'\u2013'
urllib.quote(s)

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Python27\lib\urllib.py", line 1303, in quote
    return ''.join(map(quoter, s))
KeyError: u'\u2013'

As answered here on SO, one has to use 'UTF-8' explicitly:

urllib.quote(s.encode('utf-8'))

edited May 23, 2017 at 11:47

CommunityBot

11 silver badge

answered Dec 6, 2016 at 18:41

oldbam

2,4871 gold badge21 silver badges24 bronze badges

Comments

Y2H · Accepted Answer · 2015-11-25 10:59:10Z

1

Also, if you have a dict of several values, the best way to do it will be urllib.urlencode.

answered Nov 25, 2015 at 10:59

Y2H

2,5571 gold badge21 silver badges39 bronze badges

Collectives™ on Stack Overflow

URL encoding in python

3 Answers 3

3 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

3 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related