Parsing multiple json values in linux jq [duplicate]

Question

I have json string like this:

jstring='[{"userQuery":"select name from abc;","user":"abc"},{"userQuery":"select name from xyz;","user":"xyz"},{"userQuery":"select name from ppp;","user":"ppp"}]'

I wrote a simple for loop using jq to extract values but not getting the desired result.

for i in `echo $jstring | jq '.[] | [.user, .userQuery]'`; do echo ${i}; done

With the help of this line : echo $jstring | jq '.[] | [.user, .userQuery]'. I am able to extract below info:

[ "abc", "select name from abc;"][ "xyz", "select name from xyz;"][ "ppp", "select name from ppp;"]

Now, I want two variable "user" & "query" for each array and store that info.
Eg: For [ "abc", "select name from abc;"] -- user: abc, query: "select name from abc" and store them.

I am not sure how to iterate over json using jq and get individual values and store them.

do you want to accumulate respective values in an array, like: user["abc" "xyz" "ppp"] ? — RomanPerekhrest
– RomanPerekhrest, Commented Sep 16, 2017 at 20:18
@RomanPerekhrest: No, I want to build a message and log it or email it. Eg: User: ${user} is running : ${query}. — PanwarS87
– PanwarS87, Commented Sep 16, 2017 at 20:34
The underlying question of getting results from jq to bash is commonly asked. See also these recent ones: Convert a nested JSON of objects into array into a bash array using jq and Is there a way to read all key-value pairs in the JSON file and then initialize all variables accordingly in shell? — jq170727
– jq170727, Commented Sep 16, 2017 at 21:06

glenn jackman · Accepted Answer · 2017-09-16 20:46:09Z

3

I assume you mean you want to store them as shell variables. With bash you can write:

while read -r user query; do 
    echo "user->$user"
    echo "query->$query"
done < <( jq -r '.[] | "\(.user) \(.userQuery)"' <<< "$jstring" )

user->abc
query->select name from abc;
user->xyz
query->select name from xyz;
user->ppp
query->select name from ppp;

The secret sauce is in the formulation of the string inside jq that refers to the object properties with \(.user)

I'm assuming that the user name does not contain spaces. Otherwise we have to use a different separator in that string, and use IFS with the shell read command.

answered Sep 16, 2017 at 20:46

glenn jackman

249k42 gold badges233 silver badges362 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

PanwarS87 Over a year ago

@gelnnjackman Thank you for the quick response and answer. This is perfect! I was looking at this as well: stackoverflow.com/questions/46187807/… but couldn't make it work. Thanks again!

RomanPerekhrest · Accepted Answer · 2017-09-16 21:04:47Z

2

jq + bash solution:

#!/bin/bash
jstring='[{"userQuery":"select name from abc;","user":"abc"},{"userQuery":"select name from xyz;","user":"xyz"},{"userQuery":"select name from ppp;","user":"ppp"}]'

while IFS=$'\t' read -r user query; do
    msg="User: ${user} is running : ${query}"
    mail -s "User query" "[email protected]" <<< "$msg"
done < <(jq '.[] | [.user,.userQuery] | @tsv' <<< "$jstring")

answered Sep 16, 2017 at 21:04

RomanPerekhrest

93.1k4 gold badges75 silver badges112 bronze badges

3 Comments

PanwarS87 Over a year ago

The above code did not work as expected, the code which Glenn has posted is working as expected. Please check the output, it is not working as expected.

RomanPerekhrest Over a year ago

@PanwarS87, at first, it works fine in terms of parsing and processing. Secondly, your expected output(as you said) was not clear. It was I want two variable "user" & "query" for each array and store that info - which does not look/sound clear. So I've done the man and crucial work. So, your claim sounds as preconceived

PanwarS87 Over a year ago

Sorry, I might sound unclear but when I ran the above code I am getting the below output. User: "abc\tselect name from abc;" is running : User: "xyz\tselect name from xyz;" is running : User: "ppp\tselect name from ppp;" is running : I may be missing something here or may be IFS is not working as expected.

Collectives™ on Stack Overflow

Parsing multiple json values in linux jq [duplicate]

2 Answers 2

1 Comment

3 Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

3 Comments

Linked

Related