Create an empty DF using schema from another DF (Scala Spark)

Question

I have to compare a DF with another one that is the same schema readed from a specific path, but maybe in that path there are not files so I've thought that I have to compare it with a null DF with the same columns as the original.

So I am trying to create a DF with the schema from another DF that contains a lot of columns but I can't find a solution for this. I have been reading the following posts but no one helps me:

How to create an empty DataFrame with a specified schema?

How to create an empty DataFrame? Why "ValueError: RDD is empty"?

How to create an empty dataFrame in Spark

How can I do it in scala? Or is better take other option?

krezno · Accepted Answer · 2021-03-19 21:11:09Z

8

originalDF.limit(0) will return an empty dataframe with the same schema.

answered Mar 19, 2021 at 21:11

krezno

4923 silver badges16 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Create an empty DF using schema from another DF (Scala Spark)

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related