Reading CSV with Python

Question

Im stuck on a problem. Im trying to figure out how to write a program using PYTHON to check whether all the records are the same. so far I came up with the code below. How do I check all records and not just the data within the rows are equal?

import csv

index = 0

def all_same(items):
    return all(x == items[0] for x in items)


with open(r'C:\Users\Aaron\Desktop\testfolder\data.csv') as csvfile:
    readCSV = csv.reader(csvfile, delimiter = ',')

    for row in readCSV:
            print (row)
            print (all_same(row))

the output looks like this:

['1', '1', '1', '2']
False
['1', '1', '1', '1']
True
['1', '1', '1', '1']
True

why your code are not comparing all your data? are u getting wrong output? — levi
– levi, Commented Feb 26, 2015 at 1:59

Richard · Accepted Answer · 2015-02-26 02:06:58Z

2

You could try this:

import csv

with open(r'C:\Users\Aaron\Desktop\testfolder\data.csv') as csvfile:
  readCSV = csv.reader(csvfile, delimiter = ',')
  firstrow = readCSV.next()
  print(all(row==firstrow for row in readCSV))

answered Feb 26, 2015 at 2:06

Richard

62.7k40 gold badges198 silver badges277 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

David · Accepted Answer · 2015-02-26 02:00:09Z

1

If you wanted, you could put them all into a list and then check the value of that list:

data = []
for row in readCSV:
    data.append(row)

print (all_same(data))

answered Feb 26, 2015 at 2:00

David

6961 gold badge6 silver badges20 bronze badges

Comments

Community · Accepted Answer · 2017-05-23 12:06:14Z

1

You may want to see a similar question on matching rows in Pandas dataframes listed below. One of the solutions in that question would apply here as well.

import pandas as pd

csv_filename = "file.csv" #your filepath
raw_data = pd.read_csv(csv_filename)

tmp = raw_data    
for idx, val in random_sample.iteritems():
    try:
        if np.isnan(val):
            continue
    except:
        pass
    tmp = tmp[tmp[idx] == val]
if len(tmp) == 1: print "match"

Efficiently find matching rows (based on content) in a pandas DataFrame

edited May 23, 2017 at 12:06

CommunityBot

11 silver badge

answered Feb 26, 2015 at 2:15

unique_beast

1,4803 gold badges14 silver badges23 bronze badges

1 Comment

gong15A Over a year ago

thanks for that. I have figured another way of doing it. I might try your way as well.

bcollins · Accepted Answer · 2015-02-26 02:19:44Z

1

Don't forget about Pandas

import pandas
df = pandas.read_csv(r'C:\Users\Aaron\Desktop\testfolder\data.csv')
pandas.unique(df.values)

answered Feb 26, 2015 at 2:19

bcollins

3,4794 gold badges23 silver badges37 bronze badges

1 Comment

gong15A Over a year ago

thanks for that. Im checking all data are the same length not whether they are unique or not.

Collectives™ on Stack Overflow

Reading CSV with Python

4 Answers 4

Comments

Comments

1 Comment

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

Comments

1 Comment

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related