Write to csv file from deltalake table in databricks

Question

How do I write the contents of a deltalake table to a csv file in Azure databricks? Is there a way where I do not have to first dump the contents to a dataframe? https://docs.databricks.com/delta/delta-batch.html

SA2010 · Accepted Answer · 2019-09-09 09:59:35Z

1

While loading the data to the Delta table, I used an ADLS Gen2 folder location for the creation of the versioned parquet files.

The conversion of parquet to CSV could then be accomplished using the Copy Data Activity in ADF.

answered Sep 9, 2019 at 9:59

SA2010

3235 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Greenonline · Accepted Answer · 2021-01-29 10:10:12Z

0

You can simply use Insert Overwrite Directory.

The syntax would be

INSERT OVERWRITE DIRECTORY <directory_path> USING <file_format> <options> select * from table_name

Here you can specify the target directory path where to generate the file. The file could be parquet, csv, txt, json, etc.

edited Jan 29, 2021 at 10:10

Greenonline

1,3778 gold badges25 silver badges36 bronze badges

answered Jan 26, 2021 at 17:22

abhishek kala

162 bronze badges

Collectives™ on Stack Overflow

Write to csv file from deltalake table in databricks

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related