Issue with coma delimiter CSV Python

Question

I work with a sample of CSV file which is like this :

3256221406917,DESCRIPTION1,"U Bio,  U",food
3256223662106,DESCRIPTION2,"U Bio,  U",food

I want to parse it with comas :

def import_csv(csvfilepath):
data = []
product_file = open(csvfilepath, "r")
reader = csv.reader(product_file, delimiter=',')
for row in reader:
    if row:  # avoid blank lines
        columns = [row[0], row[1], row[2], row[3], row[4]]
        data.append(columns)

return data

However it returns a "list index out of range" issue when running.

I believe that the trouble might come from third and fourth column as there is opening and closing double quotes. But I don't understand why the delimiter = ',' seems not used.

Do you know why ? Thank you for your help !

EDIT :

Thank you all I was simply not sure why "," was read after '"' and if there was a way to change it, but it seems simpler to remove the ' "' before !

What do you expect ? The row looks like this: ['3256221406917', 'DESCRIPTION1', 'U Bio, U', 'food'] — Maurice Meyer
– Maurice Meyer, Commented Dec 10, 2018 at 14:07
you must check that all rows have 5 columns. you're trying to get row[4] maybe it doesn't exist. use assert len(rows) == 5, 'len 5 expected %s' % ";".join(row) — user2652620
– user2652620, Commented Dec 10, 2018 at 14:09
csv module supports reading fields with comma: stackoverflow.com/questions/8311900/… — MGP
– MGP, Commented Dec 10, 2018 at 14:10

user2715157 · Accepted Answer · 2018-12-10 14:05:16Z

0

I believe you can use pandas for this:

df = pd.read_csv('your-data.csv')
df_to_list = df.values.tolist()

answered Dec 10, 2018 at 14:05

user2715157

Sign up to request clarification or add additional context in comments.

1 Comment

SidGabriel Over a year ago

I don't know pandas, I should read about it. I was wondering how to parse "," before ' " ' while reading with CSV reader, but it seems that it's simply not how it is working and should remove the ' " ' first. Thank you !

Preetham · Accepted Answer · 2018-12-10 14:14:15Z

0

Try replacing

columns = [row[0], row[1], row[2], row[3], row[4]] with columns = [row[0], row[1], row[2], row[3]]

As there are only 4 columns in the CSV in your example.

answered Dec 10, 2018 at 14:14

Preetham

7188 silver badges10 bronze badges

Comments

Charles Landau · Accepted Answer · 2018-12-10 14:22:23Z

0

I don't see that you need csvreader for this, and I think that if you want to enforce splitting on ALL commas then I guess you can try this approach:

def import_csv(csvfilepath):
  data = []
  with open(csvfilepath, "r") as product_file:
  for r in productfile:
      row = r.split(",")
      if len(r) == 5: # Vary this to change the sensitivity
          columns = [row[0], row[1], row[2], row[3], row[4]]
          data.append(columns)

  return data

edited Dec 10, 2018 at 14:22

answered Dec 10, 2018 at 14:11

Charles Landau

4,2751 gold badge13 silver badges25 bronze badges

2 Comments

SidGabriel Over a year ago

I just tried but with this seems to return only the first number ("3")

Charles Landau Over a year ago

Yes I had an error in there you're right. I think I edited it out now @SidGabriel

Collectives™ on Stack Overflow

Issue with coma delimiter CSV Python

3 Answers 3

1 Comment

Comments

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related