How to add Multiple columns to the existing Dataframe?

Question

I have to add multiple column to the existing dataframe without any static value. I tried with withColumn dataframe.withColumn(c,col(c)) but I have more than 10 columns to add. How can I do that ?

Seq(col1,col2,col3 ... col10).foldLeft(ds)((acc,c) => acc.withColumn(c,col(c)))??? — Andrzej Jozwik
– Andrzej Jozwik, Commented Mar 20, 2017 at 9:01

Andrzej Jozwik · Accepted Answer · 2017-03-21 09:54:11Z

4

import org.apache.spark.sql._

val newDs:DataFrame =Seq("col1","col2","col3").foldLeft[DataFrame](ds)(
     (acc,c) => 
          acc.withColumn(c,col(c))
     )

answered Mar 21, 2017 at 9:54

Andrzej Jozwik

14.8k3 gold badges61 silver badges70 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to add Multiple columns to the existing Dataframe?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related