convert the following json to csv using python

Question

{"a":"1","b":"1","c":"1"}
{"a":"2","b":"2","c":"2"}
{"a":"3","b":"3","c":"3"}
{"a":"4","b":"4","c":"4"}

I have tried the following code but it gives error:-

from nltk.twitter import Twitter
from nltk.twitter.util import json2csv

with open('C:/Users/Archit/Desktop/raw_tweets.json', 'r') as infile:
# Variable for building our JSON block
json_block = []

for line in infile:

    # Add the line to our JSON block
    json_block.append(line)

    # Check whether we closed our JSON block
    if line.startswith('{'):

        # Do something with the JSON dictionary
        json2csv(json_block, 'tweets.csv', ['id','text','created_at','in_reply_to_user_id','in_reply_to_screen_name','in_reply_to_status_id','user.id','user.screen_name','user.name','user.location','user.friends_count','user.followers_count','source'])

        # Start a new block
        json_block = []

Error:

File "C:\Python34\lib\json\decoder.py", line 361, in raw_decode raise ValueError(errmsg("Expecting value", s, err.value)) from None ValueError: Expecting value: line 1 column 1 (char 0)

Sorry, I'll be a bit more explicit. You're using the json2csv function, but that is not defined anywhere. Are you importing it from somewhere? When I run your code, I get NameError: name 'json2csv' is not defined. — Joost
– Joost, Commented Oct 29, 2015 at 13:58
That is relevant information and should be included in your question. — Joost
– Joost, Commented Oct 29, 2015 at 14:01

Mark Tolonen · Accepted Answer · 2015-10-29 15:22:44Z

1

import csv, json

data = []

with open('C:\Users\Shahriar\Desktop\T.txt') as data_file:    
    for line in data_file:
        data.append(json.loads(line))


keys = data[0].keys()

with open('data.csv', 'wb') as csvF:
    csvWriter = csv.DictWriter(csvF, fieldnames=keys)
    csvWriter.writeheader()
    for d in data:
        csvWriter.writerow(d)

Output:

a,c,b
1,1,1
2,2,2
3,3,3
4,4,4

edited Oct 29, 2015 at 15:22

Mark Tolonen

181k26 gold badges182 silver badges278 bronze badges

answered Oct 29, 2015 at 14:24

Shahriar

13.9k11 gold badges83 silver badges97 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

user4215649 · Accepted Answer · 2016-03-11 09:53:55Z

1

This is way too late but I also stumbled upon some errors today. I figured that you actually have to import from nltk.twitter.common instead of util. Hope this helps others who stumbled upon this thread

answered Mar 11, 2016 at 9:53

user4215649

254 bronze badges

Comments

tashuhka · Accepted Answer · 2015-10-29 15:14:00Z

0

# Read json 
filename = 'C:/Users/Archit/Desktop/raw_tweets.json'
lines = [line.replace("{", "").replace("}", "").replace(":", ",") for line in open(filename)]

# Write csv
with open('out.csv', 'w') as csv_file:
   for line in lines:
      csv_file.write("%s\n" % line)

edited Oct 29, 2015 at 15:14

answered Oct 29, 2015 at 13:57

tashuhka

5,1564 gold badges50 silver badges67 bronze badges

4 Comments

Archit Garg Over a year ago

raceback (most recent call last): File "C:\Users\Archit\Desktop\csv_conv.py", line 35, in <module> csv_file.write("%s\n" % line) io.UnsupportedOperation: not writable

Shahriar Over a year ago

"a","1","b","1","c","1" is this your output csv?

tashuhka Over a year ago

@ArchitGarg thank you, it was missing the opening mode

tashuhka Over a year ago

@AerofoilKite Yes. The OP didn't specify the output format. So, it is safer to to include the quotes in case the elements have commas, like "0", "0,5", "1"...

Collectives™ on Stack Overflow

convert the following json to csv using python

3 Answers 3

Comments

Comments

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related