Can not read csv file, pandas parser error

Question

I am getting parser error from pandas lib...not sure what could be the issue.

Traceback (most recent call last):
  File "C:/2020/python-nifi/test.py", line 4, in <module>
    df = pd.read_csv("C:\\2020\\test\\sum.csv", '\t')
  File "C:\2020\python-nifi\venv\lib\site-packages\pandas\io\parsers.py", line 676, in parser_f
    return _read(filepath_or_buffer, kwds)
  File "C:\2020\python-nifi\venv\lib\site-packages\pandas\io\parsers.py", line 454, in _read
    data = parser.read(nrows)
  File "C:\2020\python-nifi\venv\lib\site-packages\pandas\io\parsers.py", line 1133, in read
    ret = self._engine.read(nrows)
  File "C:\2020\python-nifi\venv\lib\site-packages\pandas\io\parsers.py", line 2037, in read
    data = self._reader.read(nrows)
  File "pandas\_libs\parsers.pyx", line 860, in pandas._libs.parsers.TextReader.read
  File "pandas\_libs\parsers.pyx", line 875, in pandas._libs.parsers.TextReader._read_low_memory
  File "pandas\_libs\parsers.pyx", line 929, in pandas._libs.parsers.TextReader._read_rows
  File "pandas\_libs\parsers.pyx", line 916, in pandas._libs.parsers.TextReader._tokenize_rows
  File "pandas\_libs\parsers.pyx", line 2071, in pandas._libs.parsers.raise_parser_error
pandas.errors.ParserError: Error tokenizing data. C error: Expected 1 fields in line 5, saw 4



import pandas as pd


df = pd.read_csv("C:\\2020\\test\\sum.csv", sep='\t')
print(df)

file trying to read is ...

enter image description here

The error is printed here Expected 1 fields in line 5, saw 4, could assist better if you share a sample of your dataframe df — Cavin Dsouza
– Cavin Dsouza, Commented Apr 29, 2020 at 8:56
If you want, you can skip erroneous lines using: pandas.read_csv(fileName, sep='delimiter' , error_bad_lines=False) — narendra-choudhary
– narendra-choudhary, Commented Apr 29, 2020 at 8:57
@narendra-choudhary, you mean remove/escape pipe '|' in the cell? — Kumar Prvn
– Kumar Prvn, Commented Apr 29, 2020 at 9:02
after adding "error_bad_lines=False..got little different error.. — Kumar Prvn
– Kumar Prvn, Commented Apr 29, 2020 at 9:05

Subbu VidyaSekar · Accepted Answer · 2020-04-29 21:10:00Z

1

And if you use df = pd.read_csv("filename", sep='[:,|_]',engine='python' ) ? As you can use multiple seperators on import.

edited Apr 29, 2020 at 21:10

Subbu VidyaSekar

2,6413 gold badges25 silver badges45 bronze badges

answered Apr 29, 2020 at 9:49

karel van dongen

4252 silver badges8 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Kumar Prvn Over a year ago

Thanks Karel, it was issue with the corrupted csv

Subbu VidyaSekar · Accepted Answer · 2020-04-29 09:57:18Z

0

This error comes because of encoding error:

try this:

df = pd.read_csv('filename', encoding='utf-8')

answered Apr 29, 2020 at 9:57

Subbu VidyaSekar

2,6413 gold badges25 silver badges45 bronze badges

Collectives™ on Stack Overflow

Can not read csv file, pandas parser error

2 Answers 2

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related