Converting nested JSON to flattened Pandas Dataframe

Question

I know there has been already several questions on this topic, but I can't find the answer.

I have a nested JSON, let's say:

data = {'items': [{'block': 1,
   'log_events': [{'decoded': {'name': 'Transfer'},
     'params': ['param0', 'param1', 'param2']}]},
  {'block': 2,
   'log_events': [{'decoded': {'name': 'SafeReceived'},
     'params': ['param3', 'param4', 'param5']}]}]}

I tried:

pd.json_normalize(
    data=data['items'],
    record_path=['log_events'],
    meta=['block']
)

But I would like to "flatten" both on the 'log_events' and on the 'params'. How can I do that ?

Please share your expected output.

Mayank Porwal
– Mayank Porwal

2022-04-26 10:45:54 +00:00
Commented Apr 26, 2022 at 10:45 — Mayank Porwal
– Mayank Porwal, Commented Apr 26, 2022 at 10:45

jezrael · Accepted Answer · 2022-04-26 10:48:07Z

1

IIUC use:

df = pd.json_normalize(
    data=data['items'],
    record_path=['log_events'],
    meta=['block']
).explode('params').reset_index(drop=True)
print (df)
   params  decoded.name block
0  param0      Transfer     1
1  param1      Transfer     1
2  param2      Transfer     1
3  param3  SafeReceived     2
4  param4  SafeReceived     2
5  param5  SafeReceived     2

answered Apr 26, 2022 at 10:48

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Converting nested JSON to flattened Pandas Dataframe

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related