Python Dataframe Convert string to list type

Question

I have a CSV file coming from the field. It has the data in a peculiar format. That is, a list of values in string format. I want to convert it to the list type

My code:

df = pd.DataFrame({'x':['-1,0,1,2,10','1.5,2,4,5'],'y':['2.5,2.4,2.3,1.5,0.1','5,4.5,3,-0.1']})
df =
                   x                          y
0  '-1, 0, 1, 2, 10'  '2.5, 2.4, 2.3, 1.5, 0.1'
1     '1.5, 2, 4, 5'          '5, 4.5, 3, -0.1'

Expected answer:

df = 
                   x                          y
0  [-1, 0, 1, 2, 10]  [2.5, 2.4, 2.3, 1.5, 0.1]
1     [1.5, 2, 4, 5]          [5, 4.5, 3, -0.1]

Use str.split: df.apply(lambda x: x.str.split(', '))

akuiper
– akuiper

2021-07-20 17:56:24 +00:00
Commented Jul 20, 2021 at 17:56 — akuiper
– akuiper, Commented Jul 20, 2021 at 17:56

Shubham Sharma · Accepted Answer · 2021-07-20 18:03:45Z

1

applymap with ast.literal_eval would be the fastest option

import ast

df.applymap(ast.literal_eval)

Note this will produce tuples in output, although it doesn't matter but if you specifically need lists in your output then we can chain another applymap

df.applymap(ast.literal_eval).applymap(list)

                   x                          y
0  [-1, 0, 1, 2, 10]  [2.5, 2.4, 2.3, 1.5, 0.1]
1     [1.5, 2, 4, 5]          [5, 4.5, 3, -0.1]

answered Jul 20, 2021 at 18:03

Shubham Sharma

71.8k6 gold badges26 silver badges58 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python Dataframe Convert string to list type

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related