Parsing CSV to python dictionary using pandas

Question

I have following DataFrame parsed into Python:

df = pd.read_csv("my_file.csv")

result:

   indexes X_values Y_values
0       IDX1     x1      y1
1       IDX1     x2      y2
2       IDX1     x3      y3
3       IDX1     x4      y4
6       IDX2     x1      y1
9       IDX2     x4      y4
10      IDX3     x1      y1
11      IDX3     x2      y2

I need to create dictionaries with each indexes as key and x_values & y_values as list of nested dictionaries. Output should be like:

{"IDX1" : [{"x1": "y1"}, {"x2": "y2"}, {"x3": "y3"}, {"x4": "y4"}],
"IDX2": [{"x1": "y1"},{"x4": "y4"}],
"IDX3":[{"x1": "y1"}, {"x2": "y2"}]}

I am trying to parse it using set_index() method but always missing something. Could you help me?

Also, dictionary of nested dictionaries with indexes as keys would be also good solution.

Ynjxsjmh · Accepted Answer · 2022-07-04 15:26:54Z

1

You can try

out = (df.apply(lambda row: {row['X_values']: row['Y_values']}, axis=1)
       .groupby(df['indexes']).agg(list).to_dict())

print(out)

{'IDX1': [{'x1': 'y1'}, {'x2': 'y2'}, {'x3': 'y3'}, {'x4': 'y4'}], 'IDX2': [{'x1': 'y1'}, {'x4': 'y4'}], 'IDX3': [{'x1': 'y1'}, {'x2': 'y2'}]}

answered Jul 4, 2022 at 15:26

Ynjxsjmh

30.3k7 gold badges43 silver badges64 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

BENY · Accepted Answer · 2022-07-04 15:26:30Z

1

We can do

d = df[['X_values','Y_values']].apply(lambda x : {x[0]:x[1]},axis=1).groupby(df['indexes']).agg(list).to_dict()
Out[104]: 
{'IDX1': [{'x1': 'y1'}, {'x2': 'y2'}, {'x3': 'y3'}, {'x4': 'y4'}],
 'IDX2': [{'x1': 'y1'}, {'x4': 'y4'}],
 'IDX3': [{'x1': 'y1'}, {'x2': 'y2'}]}

answered Jul 4, 2022 at 15:26

BENY

324k22 gold badges176 silver badges250 bronze badges

Comments

Sorin Burghiu · Accepted Answer · 2022-07-04 15:26:41Z

0

Sounds like you need to make use of the to_dict() method (documentation).

You might need to index like you say. I would try:

df.set_index('indexes').T.to_dict('list')

answered Jul 4, 2022 at 15:26

Sorin Burghiu

8192 gold badges9 silver badges34 bronze badges

1 Comment

YggY Over a year ago

This only returns one pair of x_values & y_values for each indexes.

Collectives™ on Stack Overflow

Parsing CSV to python dictionary using pandas

3 Answers 3

Comments

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related