changing string format into date [duplicate]

Question

I need to change string into date format 'YYYY-MM-DD'
Input data is

20180716
20180912

like this in string type and need output as

2018-07-16
2018-09-12

spark.sql("""select TO_DATE(CAST(UNIX_TIMESTAMP(MYDAT, 'yyyyMMdd') AS TIMESTAMP)) AS reg_datefrom Table  """)

query for above output is

reg_date
null    
null    
null    
null    
null

But when I am writing below code its working.

spark.sql("""
  SELECT TO_DATE(CAST(UNIX_TIMESTAMP('20180811', 'yyyyMMdd') AS TIMESTAMP)) AS newdate"""
).show()

Output:

+----------+ | newdate| +----------+ |2018-08-11| +----------+

Where I am doing mistake.

show the output of query select MYDAT,TO_DATE(CAST(UNIX_TIMESTAMP(MYDAT, 'yyyyMMdd') AS TIMESTAMP)) AS reg_date from Table — undefined_variable
– undefined_variable, Commented Nov 27, 2018 at 9:54

Bhima Rao Gogineni · Accepted Answer · 2018-11-27 10:50:00Z

0

In Spark, we can write the TO_DATE('20180811', 'yyyyMMdd') function by passing the date format of the string value that passing to TO_DATE function and returns the date as yyyy-MM-dd

answered Nov 27, 2018 at 10:50

Bhima Rao Gogineni

2771 silver badge8 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Mahesh J · Accepted Answer · 2018-11-27 10:50:34Z

0

I have tried this at my end, this is working however I feel 2 possibilities looking at your snippet

Please check your MYDAT column is string
in ur query reg_datefrom is concatnated, seprate it

answered Nov 27, 2018 at 10:50

Mahesh J

1241 silver badge10 bronze badges

Collectives™ on Stack Overflow

changing string format into date [duplicate]

2 Answers 2

Comments

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Linked

Related