How to convert Array[String] to String* in scala with spark

Question

I hava a RDD and a Array[String],I want to convert RDD to DataFrame,the Array[String]'s value are colnames,but DataFrame.toDf() function need a String* type

this is toDF()'s source code:

    def toDF(colNames: String*): DataFrame = ds.toDF(colNames : _*)

this is my code:

 val sqlContext = new SQLContext(sc)
    import sqlContext.implicits._
    val arr=Array(
      (1,2),
      (3,2),
      (4,2),
      (5,2),
      (7,2)

    )
    val colNames=Array("first","second")
    val df = sc.parallelize(arr,2).toDF("??","??")

this is my expect result:

+-----+------+
|first|second|
+-----+------+
|    1|     2|
|    3|     2|
|    4|     2|
|    5|     2|
|    7|     2|
+-----+------+

Possible duplicate of Pass List[String] to function that takes f(args: String*) scala — eliasah
– eliasah, Commented Jul 10, 2017 at 6:18

chengpohi · Accepted Answer · 2017-07-10 02:49:44Z

3

Use _* for varargs in Scala, so you can do it by: sc.parallelize(arr,2).toDF(colNames:_*)

answered Jul 10, 2017 at 2:49

chengpohi

14.2k1 gold badge28 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to convert Array[String] to String* in scala with spark

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related