My python code is not importing JSON data correctly to CSV

Question

So i am trying to import json data from file and want to export in CSV file. Only few tags like "authors" and "title" work fine with this code but when i try that for "abstract" it split every word of abstract in new column of csv. Before I try split() it was doing the same for every character

here is my code

import json
import csv
filename="abc.json"
csv_file= open('my.csv', 'w',encoding="utf-8")
csvwriter = csv.writer(csv_file)
with open(filename, 'r') as f:
     for line in f:
         data = json.loads(line)
         if 'abstract' in data:
             csvwriter.writerow(data['abstract'].split())
         elif 'authors' in data:
               csvwriter.writerow(data['authors'])
         else:
              f="my"

sample json file can be downloaded from here http://s000.tinyupload.com/?file_id=28925213311182593120

Can you copy and paste a sample of the JSON file that you're using as text in your question and a sample of both the actual and expected csv from that sample JSON. You're asking people to click on a random link on the internet to a file that they don't know what it is. — Ben
– Ben, Commented Aug 1, 2018 at 13:42

Brandon Ellis · Accepted Answer · 2018-08-01 13:50:43Z

1

Like Ben said, it would be great to see a sample from the JSON file, but the issue could be with how your trying to split your abstract data. With what you're doing now, you're asking it to split at every space. Try something like this if you're wanting to split by line:

if 'abstract' in data:
         csvwriter.writerow(data['abstract'].split(","))

answered Aug 1, 2018 at 13:50

Brandon Ellis

212 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Umer iqbal Over a year ago

Thanks but that did half the job. Thr issue is abstract itself contains "," character in sentences. This split the sentence into column whenever a "," character comes

maor10 · Accepted Answer · 2018-08-01 13:50:54Z

1

The reason this happened in abstract is because the value of abstract is a string (in contrast, the value of authors is a list). writerow receives an iterable, and when you iterate over a string in python you get a letter each time.

So before you used split, python took the string and divided it into letters, thereby giving you one letter per column. When you used split, you transformed the string into a list of words, so when you iterate over it you get a word each time.

If you want to split abstract by periods, just do the same thing with .split('.')

answered Aug 1, 2018 at 13:50

maor10

1,8241 gold badge19 silver badges30 bronze badges

2 Comments

Umer iqbal Over a year ago

Thanks but that did half the job. Thr issue is abstract itself contains "," character in sentences. This split the sentence into column whenever a "," character comes

maor10 Over a year ago

if you do .split('.') then the commas won't matter

Collectives™ on Stack Overflow

My python code is not importing JSON data correctly to CSV

2 Answers 2

1 Comment

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related