parsing a JSON file with multiple JSONs

Question

I have a JSON file created as response by running multiple curl statements (GET requests to a service) in parallel.

Now when I try to parse the JSON file using python it fails as the file has multiple JSONs appended

Error:

Error: Parse error on line 1: ...CT_AGGREGATE"}]}]}]}{"serviceResponseTim -----------------------^ Expecting 'EOF', '}', ',', ']', got '{'

Example in the file:

{"serviceResponseTime":510, ........... .......:[{"categoryId":28162,"metricValue":97,"days":"NONE","metricMappedType":"PRODUCT_AGGREGATE"}]}]}]}{"serviceResponseTime":387,"products":[{"productReferenceId":...................

As you see these are 2 response obtained from 2 curl statements but as I ran them in parallel using xargs, it appended the output in 1 line.

Now my problem is parsing this file.

Can anyone suggest a way to either put the output of curl commands into separate lines in the file.

Or a crude way I thought was if I could extract the part from beginning of the file till "}]}]}]}{", cut from the current file and put it into another file and run the JSON parser on that file which would have just 1 JSON o/p. Repeat this in loop till the original file is empty after we have cut out each of the JSON from it. Now my problem is I am not able to extract from beginning of line to }]}]}]}{.

Also all JSON o/ps are appended in 1 line and are not on separate lines else I would have read line by line.

Can anyone help here?

hek2mgl · Accepted Answer · 2016-11-19 09:04:38Z

3

Let's say you have this input file:

{"name": "foo"}{"name": "bar"}

You can use the jq command:

jq -s . input.file

to transfer input.file into:

[
  {
    "name": "foo"
  },
  {
    "name": "bar"
  }
]

I hope that helps

answered Nov 19, 2016 at 9:04

hek2mgl

159k31 gold badges263 silver badges279 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

donny Over a year ago

I installed jq on my mac and run the command but it says -sh: jq: command not found

Collectives™ on Stack Overflow

parsing a JSON file with multiple JSONs

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related