Using pandas how I can count the line occurrences in a csv file Python

Question

Here is the file input: File Input

Using the above file, how I can count the line occurences in a csv file using pandas and write in another file with the count appended? and should remove the rest duplicate lines.

For example:

0   1   1   1   -1  -1  -1  1   yesno
0   1   -1  -1  1   1   1   -1  no
0   1   -1  -1  -1  -1  -1  -1  yes
0   1   1   1   -1  -1  -1  1   yesno
1   0   1   1   -1  -1  -1  1   yesno
1   0   1   1   1   -1  -1  -1  yesno
1   0   1   1   1   -1  -1  -1  yesno
0   1   1   1   -1  -1  -1  1   yesno
0   1   -1  -1  1   1   1   -1  no
0   1   -1  -1  -1  -1  -1  -1  yes
0   1   1   1   -1  -1  -1  1   yesno
1   0   1   1   -1  -1  -1  1   yesno
1   0   1   1   1   -1  -1  -1  yesno
1   0   1   1   1   -1  -1  -1  yesno

Output should be

0   1   1   1   -1  -1  -1  1   yesno 2
0   1   -1  -1  1   1   1   -1  no 2
0   1   -1  -1  -1  -1  -1  -1  yes 2
0   1   1   1   -1  -1  -1  1   yesno 2
1   0   1   1   -1  -1  -1  1   yesno 2
1   0   1   1   1   -1  -1  -1  yesno 2
1   0   1   1   1   -1  -1  -1  yesno 2

count the line in the complete file and removing the duplicate and write the number of occurrences before of the line of the row of the csv.. I hope you got it. — Jaffer Wilson
– Jaffer Wilson, Commented Jun 21, 2018 at 11:52
@jpp you can check the example I have define in the question — Jaffer Wilson
– Jaffer Wilson, Commented Jun 21, 2018 at 11:53
Is yesno / no / etc final column included in determining a repeat? — jpp
– jpp, Commented Jun 21, 2018 at 11:58

Yuvraj Jaiswal · Accepted Answer · 2018-06-21 11:54:36Z

2

You can do something like this

df.groupby(df.columns.tolist(),as_index=False).size()

Please see this How to count duplicate rows in pandas dataframe?

Once you have this, you can write it to file or do whatever is needed.

answered Jun 21, 2018 at 11:54

Yuvraj Jaiswal

1,73317 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Using pandas how I can count the line occurrences in a csv file Python

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related