Inconsistency in Java Script and Python Result for encoding URLs

Question

I am trying to programmatically generate URLs using Python. It works when using Java Script method ( encodeURIComponent ) but doesn't give same output when using Python ( urllib.urlencode )

This is the schema :

{
    "page": {
        "filters": {
            "power": {
                "keywordArray": [{
                    "keyword": "random word",
                    "isNegated": false
                }],
                "date": {
                    "from": "2019-04-22T08:00:00.000Z",
                    "to": "2019-05-22T08:00:00.000Z"
                }
            }
        }
    }
}

I successfully tried Java Script method encodeURIComponent using ( https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/encodeURIComponent ):

console.log(encodeURIComponent('({"page":{"filters":{"power":{"keywordArray":[{"keyword":"random word", "isNegated":False}],"date":{"from":"2019-04-22T08:00:00.000Z","to":"2019-05-22T08:00:00.000Z"}}}}})'));


(%7B%22page%22%3A%7B%22filters%22%3A%7B%22power%22%3A%7B%22keywordArray%22%3A%5B%7B%22keyword%22%3A%22random%20word%22%2C%20%22isNegated%22%3AFalse%7D%5D%2C%22date%22%3A%7B%22from%22%3A%222019-04-22T08%3A00%3A00.000Z%22%2C%22to%22%3A%222019-05-22T08%3A00%3A00.000Z%22%7D%7D%7D%7D%7D)

I am not able to generate same output using Python :

params = {
    "page": {
        "filters": {
            "power": {
                "keywordArray": [{
                    "keyword": "random word",
                    "isNegated": False
                }],
                "date": {
                    "from": "2019-04-22T08:00:00.000Z",
                    "to": "2019-05-22T08:00:00.000Z"
                }
            }
        }
    }
}
urllib.urlencode(params )

Output : 
'page=%7B%27filters%27%3A+%7B%27power%27%3A+%7B%27date%27%3A+%7B%27to%27%3A+%272019-05-22T08%3A00%3A00.000Z%27%2C+%27from%27%3A+%272019-04-22T08%3A00%3A00.000Z%27%7D%2C+%27keywordArray%27%3A+%5B%7B%27keyword%27%3A+%27random+word%27%2C+%27isNegated%27%3A+False%7D%5D%7D%7D%7D'

The output using Python is different than that using Java Script (which is correct )

Alberto Rivera · Accepted Answer · 2019-05-27 21:35:11Z

1

In javascript, you are encoding the whole object as a string for the url, while Python, urllib.urlencode "convert[s] a mapping object or a sequence of two-element tuples to a “percent-encoded” string". That is, the object passed will be interpreted as an url like

page => <restOfTheObject>

To have the same behaviour as in javascript, you should first convert the object to a json string, and then pass it to urllib.parse.quote

import urllib.parse
import json

params = {
    "page": {
        "filters": {
            "power": {
                "keywordArray": [{
                    "keyword": "random word",
                    "isNegated": False
                }],
                "date": {
                    "from": "2019-04-22T08:00:00.000Z",
                    "to": "2019-05-22T08:00:00.000Z"
                }
            }
        }
    }
}
urllib.parse.quote(json.dumps(params, separators=(',', ':')))

answered May 27, 2019 at 21:35

Alberto Rivera

3,7623 gold badges23 silver badges33 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

QHarr Over a year ago

Nicely answered there +

zebra13 Over a year ago

Thank You . Works like a charm

Collectives™ on Stack Overflow

Inconsistency in Java Script and Python Result for encoding URLs

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related