how to extract values in array of array strings in RDD

Question

val rdd :Array[Array[String]] = Array(Array("2345","345","fghj","dfhg")
                                ,Array("2345","3450","fghj","dfhg")
                                ,Array("23145","1345","fghj","dffghg")
                                ,Array("23045","345","feghj","adfhg"))

this is my input. I need to extract first two elements of each array in the form of key value pair.

I would like to get output

(2345,345)
(2345,3450)
(23145,1345)
(23045,345)

Anahcolus · Accepted Answer · 2018-03-16 06:07:29Z

2

You can simply do

rdd.map(array => (array(0), array(1)))
//res0: Array[(String, String)] = Array((2345,345), (2345,3450), (23145,1345), (23045,345))

If you want the output in Map then you can add .toMap function call

rdd.map(array => (array(0), array(1))).toMap
//res0: scala.collection.immutable.Map[String,String] = Map(2345 -> 3450, 23145 -> 1345, 23045 -> 345)

edited Mar 16, 2018 at 6:07

answered Mar 16, 2018 at 6:01

Anahcolus

42.1k6 gold badges75 silver badges101 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

premon Over a year ago

im getting as array output .i would like to get as key value pair

Collectives™ on Stack Overflow

how to extract values in array of array strings in RDD

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related