Convert List Like String to Python Dataframe

Question

I have string variable which contains list like values

How To convert string values to dataframe?

string = '[[2017, 1050], [2016, 1069], [2015, 1173]]'
pd.DataFrame([item for item in string])

# Giving wrong results

Need result like below

      0     1
0  2017  1050
1  2016  1069
2  2015  1173

Also, second column contains special characters like (s) -- NA w * - etc

ast.literal_eval raises an exception if the input isn't a valid datatype. How to overcome this?

jezrael · Accepted Answer · 2018-09-18 11:11:02Z

1

Use ast, list comprehension is not necessary:

import ast

string = '[[2017, 1050], [2016, 1069], [2015, 1173]]'

df = pd.DataFrame(ast.literal_eval(string))
print (df)
      0     1
0  2017  1050
1  2016  1069
2  2015  1173

answered Sep 18, 2018 at 11:11

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

8 Comments

jezrael Over a year ago

@SPy - Can you add sample of this bad data? But obviously it is not easy :(

jezrael Over a year ago

@SPy - I try some regex and failed. Maybe possible solution should be split, do you parse json file to lists ?

jezrael Over a year ago

@SPy - OK, data are confidental?

jezrael Over a year ago

@SPy - For me it working nice, like in this question - DF = pd.read_json(sourcePath, lines=True), for you it failed?

jezrael Over a year ago

So solution from this not working? Also added your original code.

|

Collectives™ on Stack Overflow

Convert List Like String to Python Dataframe

1 Answer 1

8 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

8 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related