how to append a dataframe to existing csv file and remove the duplicates data

Question

i have a dataframe data and csv data as following

i want to append the dataframe data to the csv file.however ,there are duplicates between the two data.so how to remove the duplicates and append new data to csv file.

jezrael · Accepted Answer · 2017-09-25 10:22:26Z

6

I think you need read_csv with DataFrame.append, then drop_duplicates and last to_csv:

pd.read_csv('file').append(df).drop_duplicates().to_csv('file')

edited Sep 25, 2017 at 10:22

answered Sep 25, 2017 at 10:03

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

grechut Over a year ago

to_csv instead of to_file :)

Collectives™ on Stack Overflow

how to append a dataframe to existing csv file and remove the duplicates data

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related