node.js parse csv file with lazy

Question

I have the following node.js code:

new lazy(fs.createReadStream('file.csv'))
  .lines
  .forEach(function(line){
    console.log(line.toString());
  });

However, I only get the last line of data this way. The contents of the csv file are as follows:

123,broken
12345,stolen
1234567,lost

What am I doing wrong here?

I also have this code for the same file:

fs.readFile(req.files.file.path, 'utf8', function (err, data) {
  if (err) throw err;
  var lines = data.split(/\r?\n/);
  console.log(lines);
});

Which returns the following array:

[ '123,broken\r12345,stolen\r1234567,lost' ]

So your file is broken, it should be \r\n not just \r; which it is as evident by your own test there. — Chad
– Chad, Commented Oct 4, 2012 at 22:23
The library (and your data.split()) look for either \r\n (carriage return, newline) or \n (newline). However your csv file is using \r as the line separator. This is incorrect; make whatever is writing your csv file use \r\n or \n. — Chad
– Chad, Commented Oct 5, 2012 at 15:55
\r was the only valid line separator on MacOS before OS X so decent plain text parsing solutions ought to be engineered to deal with it, as annoying as it may be. — hippietrail
– hippietrail, Commented Dec 31, 2012 at 3:26
@Chad This was the answer to my question as well. Thank you! — truckbot
– truckbot, Commented Oct 11, 2022 at 10:17

Brad Koch · Accepted Answer · 2013-05-25 14:54:12Z

2

\r\n, \n, and \r are all valid line endings, so you need to be prepared to split on all of them.

Convert them all to a common value before doing the split. Something like:

var lines = data.replace(/\r\n?/g, "\n").split("\n");

answered May 25, 2013 at 14:54

Brad Koch

20.5k21 gold badges114 silver badges141 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1