Split a string in scala based on string lengths

Question

I have a table with two columns, one is an id and the other a value. My value column contains 1488 characters. I have to split this column into multiple rows with 12 characters each. Example:

Dataframe:

ID  Value
 1  123456789987653ABCDEFGHI

Expected output:

ID  Value
1   123456789987
1   653ABCDEFGHI

How can this be done in Spark?

Shaido · Accepted Answer · 2019-11-11 03:30:07Z

2

Create an UDF to split a string into equal length parts using grouped. Then use explode on the resulting list of string to flatten it.

import org.apache.spark.sql.functions._

def splitOnLength(len: Int) = udf((str: String) => {
  str.grouped(len).toSeq
})

df.withColumn("Value", explode(splitOnString(12)($"Value")))

answered Nov 11, 2019 at 3:30

Shaido

28.6k26 gold badges76 silver badges82 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Split a string in scala based on string lengths

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related