loading string of json arrays in python

Question

I have a file like this and each line contains something like this string:

[{u'text': u'this', u'freq': 1}, {u'text': u'is', u'freq': 1}, {u'text': u'a', u'freq': 1}, {u'text': u'test', u'freq': 1}]

I tried to load each line into json object but I get this error:

for lineid, line in enumerate(open("myfile.txt")):
    jsonline=json.loads(line)

I get the following error:

raise ValueError(errmsg("Expecting property name", s, end))
ValueError: Expecting property name: line 1 column 2 (char 2)

I want to retrieve all 'text' from the file and have it in each line. So each line will not be json but will be the sequence of text space separated. Example:

this is a test

@Nick I noticed that you have never accepted any answer for your questions. I you don't want to, that is completely fine and you can ignore this comment. Just reminding you of the feature in case you forgot. — timgeb
– timgeb, Commented Dec 29, 2015 at 11:38

Ignacio Vazquez-Abrams · Accepted Answer · 2015-09-17 01:54:19Z

2

That's not JSON, that's a Python literal.

>>> import ast
>>> ast.literal_eval("[{u'text': u'this', u'freq': 1}, {u'text': u'is', u'freq': 1}, {u'text': u'a', u'freq': 1}, {u'text': u'test', u'freq': 1}]")
[{u'text': u'this', u'freq': 1}, {u'text': u'is', u'freq': 1}, {u'text': u'a', u'freq': 1}, {u'text': u'test', u'freq': 1}]

answered Sep 17, 2015 at 1:54

Ignacio Vazquez-Abrams

804k160 gold badges1.4k silver badges1.4k bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Nick Over a year ago

Thanks. Does it change it to the json object? How can I then retrieve the "text" fields?

Ignacio Vazquez-Abrams Over a year ago

It becomes a Python object. You treat it as you would the corresponding Python object.

Nick Over a year ago

Thanks. What do you think is the best way of extracting the "text" items? regular expression or json or ...?

Ignacio Vazquez-Abrams Over a year ago

How about accessing them the same way you would any other Python dict?

Collectives™ on Stack Overflow

loading string of json arrays in python

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related