multiple json dictionaries python

Question

I have a json file with multiple json dictionaries: the format is as following

{"x":"1", "y":"2", "z": "3"}{"x": "2","y":"3", "z":"4"}{"x":"3", "y":"4", "z":"5"}

How can I convert this to one json dictionary format as following:

{"items":[{"x":"1", "y":"2", "z": "3"},{"x": "2","y":"3", "z":"4"},{"x":"3", "y":"4", "z":"5"}]}

That file is broken. Return it to sender with kind regards to provide valid JSON, or at least a sane format. — Ilja Everilä
– Ilja Everilä, Commented May 3, 2016 at 11:27
Unfortunately I have generated this file myself from a python script which gets this data from a website. — Fawad
– Fawad, Commented May 3, 2016 at 11:59
It's very, very common to find multiple JSON elements concatenated in one file. People do not read the JSON specification or the Python json module doc. quote: "Unlike pickle and marshal, JSON is not a framed protocol so trying to serialize more objects with repeated calls to dump() and the same fp will result in an invalid JSON file. " — nigel222
– nigel222, Commented May 3, 2016 at 13:25

Community · Accepted Answer · 2017-05-23 10:28:08Z

2

Already mostly answered here: Importing wrongly concatenated JSONs in python

That shows you how to pick up each JSON element from a concatenated list of them (which is not valid JSON) using json.JSONDecoder method raw_decode(). The rest is a simple matter of concatenating strings '{"items":[', element1, ",", element2, ... "]" or alternatively, accumulating them as a list, wrapping that with a one-item dict and if required, dumping that json as a string with json.dumps

OK expanding on that

import json
d = json.JSONDecoder()

# get your concatenated json into x, for example maybe
x = open('myfile.json','r').read()

jlist=[]
while True:
   try:
      j,n = d.raw_decode(x) 
      jlist.append(j)
   except ValueError: 
      break
   x=x[n:]

# my original thought was
result = '{"items":[' + 
     ','.join( [ str(s) for s in jlist] ) +
     ']'

# but this is neater
result = json.dumps( { "items":jlist })

# and of course if you want it for programmatic use, just
result_as_json = dict( items=jlist )

edited May 23, 2017 at 10:28

CommunityBot

11 silver badge

answered May 3, 2016 at 11:45

nigel222

8,3221 gold badge19 silver badges31 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Fawad Over a year ago

I visited the link, but it doesn't seem to help much. I am a newbie in Python.

Fawad Over a year ago

import json data = [] with open('c:\\users\\fawads\\desktop\\short.json') as f: data = f.read() d = json.JSONDecoder() d.raw_decode(data) with open('c:\\users\\fawads\\desktop\\data.json', 'w') as outfile: json.dump(data, outfile) I tried this, but it didnt help.

Fawad Over a year ago

Thanks a lot. I used the above code and things are now in proper shape :)

Collectives™ on Stack Overflow

multiple json dictionaries python

1 Answer 1

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related