Skip Rows in CSV Containing Specific String

Question

I have a list of strings (longer than in this example). If one of the strings exists in a row of data, I want to skip that row. This is what I have so far but I get an index error, which leads me to believe I'm not looping correctly.

stringList = ["ABC", "AAB", "AAA"]

with open('filename.csv', 'r')as csvfile:
    filereader = csv.reader(csvfile, delimiter=',')
    next(filereader, None) #Skip header row
    for row in filereader:
        for k in stringList:
            if k not in row:
                data1 = column[1]

The error I get: IndexError: list index out of range. I realize I'm reading by row, but I need to extract the data by column.

replace data1 = column[1] by data1 = row[1]. if required add check for len(row)>1 — maximus
– maximus, Commented Apr 8, 2019 at 19:49

Legolas · Accepted Answer · 2019-04-09 20:33:38Z

1

The error is because row is a list and you are using/accessing it as a normal variable. You can access certain columns by using appropriate indexing of the list row. Eg: in the first iteration row[0] will be the element in the first-row first-column, row[1] the second column entry and so on. On subsequent iterations of row, you can access entries of subsequent column downwards.

Here's a simple loop to do it.

for row in filereader:
        for k in stringList:
            for i in range(len(row)):
                if k not in row[i]:
                    someVar=row[i]

edited Apr 9, 2019 at 20:33

answered Apr 8, 2019 at 20:00

Legolas

7931 gold badge9 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

klex52s Over a year ago

This results in an error: TypeError: 'int' object is not iterable

klex52s Over a year ago

Did you mean range(len(row))?

Legolas Over a year ago

Yes indeed, sorry for that. I've updated the answer.

Kristóf Varga · Accepted Answer · 2019-04-08 19:50:27Z

1

With pandas you can do it easily, with a mask. See more: link

import pandas as pd

data = pd.read_csv('filename.csv')
data = data.loc[data['column_name'] not in stringList]

answered Apr 8, 2019 at 19:50

Kristóf Varga

16810 bronze badges

Collectives™ on Stack Overflow

Skip Rows in CSV Containing Specific String

2 Answers 2

3 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

3 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related