Joining multiple json files using python

Question

I am new to JSON, never used python packages to manipulate JSON files. I have 10 JSON files that I would like to merge into one using python.

Each of 10 files has the exact same structure and has about 50,000 entries

Example:

File one

{"tracking_code":"21703238","from_country":"FR","to_country":"FR","amount":3.23}
...

Example: File two

{"tracking_code":"41545695","from_country":"FR","to_country":"FR","amount":2.9}
...

Desired output would simply be:

{"tracking_code":"21703238","from_country":"FR","to_country":"FR","amount":3.23}
{"tracking_code":"41545695","from_country":"FR","to_country":"FR","amount":2.9}

The second part of my questions would be this - how would I join JSON files based on one key? I would like to join these 2 files by "tracking_code", the output file would simply add '"amount":3.23' to the first file.

Example: File one:

{"tracking_code":"29285908","from_country":"FR","to_country":"FR",
"package_type_id":10,"transaction_id":172238850,
"shipping_label_created":"2018-09-25 18:40:52"}

Example: File two

{"tracking_code":"29285908","from_country":"FR","to_country":"FR","amount":3.23}

Desired output:

{"tracking_code":"29285908","from_country":"FR","to_country":"FR",
"package_type_id":10,"transaction_id":172238850,
"shipping_label_created":"2018-09-25 18:40:52","amount":3.23}

Thank you.

Possible duplicate of Issue with merging multiple JSON files in Python — shaik moeed
– shaik moeed, Commented Oct 17, 2019 at 9:01

pymym213 · Accepted Answer · 2019-10-17 10:15:31Z

0

If you use json.loads() (that "converts" json to python dictionary), you can merge them using a similar function :

def dict_merge(dict1, dict2): 
    return(dict2.update(dict1))

and then use json.dumps() to serialize the resulting dictionary to json.

Other solution :

you can also use json-merger (installation via pip install json-merger)

edited Oct 17, 2019 at 10:15

answered Oct 17, 2019 at 9:20

pymym213

3313 silver badges10 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Jonas Palačionis Over a year ago

How would I go if I have 10 files? Function with 10 inputs would look ugly, I would assume loop over files?

pymym213 Over a year ago

indeed, you would have to loop over files

pymym213 Over a year ago

json-merger usage doc : pythonhosted.org/json-merger/usage.html

Collectives™ on Stack Overflow

Joining multiple json files using python

1 Answer 1

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related