RDD of List String convert to Row

Question

I'm trying to convert an RDD that has a fixed size lists of strings (a result of parsing CSV file) into and RDD of Rows. This is so I can turn it into a dataframe, because I need it into a dataframe to write to parquet. Anyway the only part I need help with is the converting of Rdd from list of strings to Row.

The RDD variable name is RDD

Ok I converted to Row I used val RowRDD = RDD.map(r => Row.fromSeq(r)) — uh_big_mike_boi
– uh_big_mike_boi, Commented Feb 16, 2016 at 19:37

uh_big_mike_boi · Accepted Answer · 2016-02-16 23:26:17Z

3

I used:

import org.apache.spark.sql._
val RowRDD = RDD.map(r => Row.fromSeq(r))

edited Feb 16, 2016 at 23:26

answered Feb 16, 2016 at 19:37

uh_big_mike_boi

3,4685 gold badges38 silver badges72 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

RDD of List String convert to Row

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related