How to get Array[Seq[String]] from DataFrame?

Question

How to pass DataFrame cc into Array[Seq[String]]?

val factors = $(ccCols).split(",")
val cc = dataset.select(factors.head, factors.tail: _*)

I tried this way, but it gives me Array[Row]:

cc.rdd.collect()

evan.oman · Accepted Answer · 2016-05-19 16:13:42Z

5

You will need to use the toSeq function of the Row object:

val a = sc.parallelize(Seq((1,2),(3,4))).toDF("a", "b")
a.show
/*
Output:
+-+-+
|a|b|
+-+-+
|1|2|
|3|4|
+-+-+
*/

a.collect.map(_.toSeq)
// Output: Array(WrappedArray(1, 2), WrappedArray(3, 4))

answered May 19, 2016 at 16:13

evan.oman

5,57224 silver badges45 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Klue Over a year ago

It's now Array[Seq[Ahy]]. How to substitute Any by String?

evan.oman Over a year ago

I think a a.collect.map(_.toSeq.map(_.toString)) would do it

Collectives™ on Stack Overflow

How to get Array[Seq[String]] from DataFrame?

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related