getting error when export data to csv by using python

Question

I tried to export data to csv from Mongodb by using Python. I am getting error: "TypeError: can only join an iterable"

mongodb data sample:

{ "_id" : ObjectId("51dc52fec0d988a9547b5201"),
  "hiringManagerIds" : [ 
        "529f5ad1030dedd0a88ed7be", 
        "529f5ad1030dedd0a88ed7bf"
    ]
  }

Python script:

import codecs
import csv
cursor = db.jobs.find( {}, {'_id': 1, 'hiringManagerIds': 1})
with codecs.open('jobs_array.csv', 'w', encoding ='utf-8') as outfile:
    fields = ['_id', 'hiringManagerIds']    
    write = csv.writer(outfile)
    write.writerow(fields)
    for x in cursor:
        write.writerow((x["_id"], u','.join(x.get('hiringManagerIds'))))

error messages:

Traceback (most recent call last):
File "<stdin>", line 6, in <module>
TypeError: can only join an iterable

I want to remove u letters so I use u.join in the script. the hiringManagerIds filed is missing in some document, so I use get. If I don't add u''.join in the script, it works, but it brings u letters in the csv file. I tried many different ways, but it did not work. Appreciate for any helps. thanks.

This code would not run: the indentation on the last line of the first block is not correct? — Philip Adler
– Philip Adler, Commented Jul 18, 2017 at 18:40
it gives value of hiringmanagerids: [u'529f5ad1030dedd0a88ed7be', u'529f5ad1030dedd0a88ed7bf'] thanks — user7070824
– user7070824, Commented Jul 18, 2017 at 18:41
@philip-adler, thanks, when copied to here, I forgot to put space before last line. — user7070824
– user7070824, Commented Jul 18, 2017 at 18:44

SethMMorton · Accepted Answer · 2017-07-19 02:50:18Z

1

The error stems from one of the documents not having hiringManagerIds. If this is undefined, at present your code returns None into the join method, which requires an iterable (None is not an iterable).

You should check if the key is present in the dictionary first:

if 'hiringManagerIds' in x.keys():
    write.writerow((x["_id"], u','.join(x.get('hiringManagerIds'))))
else:
    write.writerow((x["_id"], '')))

edited Jul 19, 2017 at 2:50

SethMMorton

49.5k13 gold badges72 silver badges90 bronze badges

answered Jul 18, 2017 at 18:44

Philip Adler

2,22820 silver badges27 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

user7070824 Over a year ago

Thanks so much. @Philip Adler. It worked. It removes the u letters perfectly. I like your solution.

Collectives™ on Stack Overflow

getting error when export data to csv by using python

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related