URL encoding a string in bash script

Question

I am writing a bash script in where I am trying to submit a post variable, however wget is treating it as multiple URLS I believe because it is not URLENCODED... here is my basic thought

MESSAGE='I am trying to post this information'
wget -O test.txt http://xxxxxxxxx.com/alert.php --post-data 'key=xxxx&message='$MESSAGE''

I am getting errors and the alert.php is not getting the post variable plus it pretty mush is saying

can't resolve I can't resolve am can't resolve trying .. and so on.

My example above is a simple kinda sudo example but I believe if I can url encode it, it would pass, I even tried php like:

MESSAGE='I am trying to post this information'
MESSAGE=$(php -r 'echo urlencode("'$MESSAGE'");')

but php errors out.. any ideas? How can i pass the variable in $MESSAGE without php executing it?

I'm using jq for that, see stackoverflow.com/a/34407620/906265 e.g. printf %s "k=$SOMEVAL"|jq -sRr @uri — Ivar
– Ivar, Commented Sep 21, 2022 at 16:22

Rockallite · Accepted Answer · 2017-02-09 08:10:57Z

19

On CentOS, no extra package needed:

python -c "import urllib;print urllib.quote(raw_input())" <<< "$message"

answered Feb 9, 2017 at 8:10

Rockallite

17.1k7 gold badges56 silver badges49 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

Leo Gallucci Over a year ago

This solution is python 2 only

Jason R. Coombs Over a year ago

Python 3 version looks like python3 -c "import urllib.parse; print(urllib.parse.quote(input())".

Anton K Over a year ago

@JasonR.Coombs you forgot one closing brace :)

Jason R. Coombs Over a year ago

A correct Python 3 version looks like python3 -c "import urllib.parse; print(urllib.parse.quote(input()))" (tested this time).

Mike Over a year ago

Python version agnostic:

python -c $'try: import urllib.request as urllib\nexcept: import urllib\nimport sys\nsys.stdout.write(urllib.quote(input()))' <<< "$message"

and adds no \n

Walf · Accepted Answer · 2022-02-04 04:51:08Z

9

You want $MESSAGE to be in double-quotes, so the shell won't split it into separate words, then pass it to PHP as an argument:

ENCODEDMESSAGE="$(php -r 'echo rawurlencode($argv[1]);' -- "$MESSAGE")"

edited Feb 4, 2022 at 4:51

Walf

9,4793 gold badges47 silver badges67 bronze badges

answered Aug 9, 2012 at 3:39

Gordon Davisson

128k16 gold badges141 silver badges168 bronze badges

Comments

Murphy · Accepted Answer · 2019-11-26 18:19:11Z

7

Extending Rockallite's very helpful answer for Python 3 and multiline input from a file (this time on Ubuntu, but that shouldn't matter):

cat any.txt | python3 -c "import urllib.parse, sys; print(urllib.parse.quote(sys.stdin.read()))"

This will result in all lines from the file concatenated into a single URL, the newlines being replaced by %0A.

edited Nov 26, 2019 at 18:19

answered May 27, 2019 at 7:54

Murphy

4,0194 gold badges23 silver badges36 bronze badges

3 Comments

Sudip Bhattarai Over a year ago

No this doesn't work. Replace sys.stdin.read() with input() instead. Using the read() adds %0A which is file termination character.

Murphy Over a year ago

Using input() would only return the first line, but my intention was to get all lines from the file, encoded in one URL. You could easily convert %0A to newline again if necessary: [...] | sed "s/%0A/\n/g".

iainH Over a year ago

Works for me as posted by @Murphy (28/01/2020)

Collectives™ on Stack Overflow

URL encoding a string in bash script

3 Answers 3

5 Comments

Comments

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

5 Comments

Comments

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related