Scala Spark: How to convert an Array[(String,String,String)] to Map[String,Map[String,String]]

Question

I would like to convert an array of (String,String,String) to Map[String,Map[String,String]].

Example :

Input

val inputArray: Array[(String,String,String)] = Array(("elem1","elem2","elem3"),("elem4","elem5","elem6"))

Desired output

val outputMap: Map[String, Map[String, String]] = Map(
 ("elem1", Map("elem2" -> "elem3")),
 ("elem4", Map("elem5" -> "elem6"))
)

And what is the logic behind the conversion? Do you want to group all other tuples by the first element? Or will each tuple create a single map? — Luis Miguel Mejía Suárez
– Luis Miguel Mejía Suárez, Commented Jun 24, 2022 at 13:02

AminMal · Accepted Answer · 2022-06-24 12:59:48Z

1

First of all, Map("elem2" -> "elem3") is not a good choice in this case, tuples would be better as far as I can reason about (if it holds only on key-value as it is in your question). Anyway, you need to iterate over the array, and update a state of type Map[String, Map[String, String]], just like this:

inputArray.foldLeft(Map.empty[String, Map[String, String]]) {
    case (updatingMap, (elem, key, value)) => 
      updatingMap.updated(elem, Map(key -> value))
  }

Also, the question is not about spark right now, unless you explicitly declare where it relates to spark or you may want to solve your issue using spark apis over a dataframe.

answered Jun 24, 2022 at 12:59

AminMal

3,1832 gold badges10 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Scala Spark: How to convert an Array[(String,String,String)] to Map[String,Map[String,String]]

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related