0

I've a datafram having below column:

[Row(
col_1=True, 
col_2=[Row(val1=70, val2=None, val3=u'35f81fd0')], 
col_3=[
    Row(scr=100, id=u'ae288', 
    i_rs=[
            Row(a=
                [Row(id=42, value=u'10'), Row(id=49, value=u'100')], 
                c_d=None, t_i=None, name=u'', pd=413, st=0, stamp=None, t_s=50
                ), 

            Row(a=
                [Row(id=42, value=u'100'), Row(id=49, value=u'10')], 
                c_d=None, t_i=None, name=u'Jfe', pd=411, st=0, stamp=None, t_s=20
                ), 

            Row(a=
                [
                     Row(id=453, value=u'1523430000'), 
                     Row(id=709, value=u'1523516400'), 
                     Row(id=964, value=u'45'), 
                     Row(id=220, value=u'45'), 
                     Row(id=476, value=u'0'), 
                     Row(id=736, value=u'm_U:2;m_O:33;'), 
                     Row(id=340, value=u'0')
                 ], 
                c_d=None, t_i=None, name=u'', pd=1, st=0, stamp=None, t_s=10)
            ], 
    name=None, re=1, t_s=70, te=1)]
)]

I want to transform the above column and explode into multiple columns something like below:

enter image description here

How can I achieve above output in pyspark.

Improve this question
4
Related questions
50
How to explode multiple columns of a dataframe in pyspark
4
spark dataframe: explode list column
1
Explode nested struct in Spark Dataframe
Load 7 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.