How do I use Scala to parse CSV data with empty columns?

Question

The raw data looks like the following:

YAPM1,20100901,23:36:01.563,Quote,,,,,,,4563,,,,,,
YAPM1,20100901,23:36:03.745,Quote,,,,,4537,,,,,,,,

The first row has extra empty columns. I parse the data as follows:

val tokens = List.fromString(line, ',')

The result:

List(YAPM1, 20100901, 23:36:01.563, Quote, 4563)
List(YAPM1, 20100901, 23:36:03.745, Quote, 4537)

At the moment there is no way of using the resulting Lists to deduce which rows had the extra columns. How do I do this?

Ray Toal · Accepted Answer · 2011-07-11 06:25:37Z

15

Use string split and pass -1 as the second argument!

scala> "a,b,c,d,,,,".split(",")
res1: Array[java.lang.String] = Array(a, b, c, d)

scala> "a,b,c,d,,,,".split(",", -1)
res2: Array[java.lang.String] = Array(a, b, c, d, "", "", "", "")

FYI List fromString is deprecated in favor of string split.

answered Jul 11, 2011 at 6:25

Ray Toal

88.7k20 gold badges186 silver badges245 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How do I use Scala to parse CSV data with empty columns?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related