Save Pandas or Pyspark dataframe from Databricks to SharePoint

Question

How can I update a file on SharePoint with a Pandas or Pyspark dataframe from Databricks?

Is it possible or is the only option to upload the file from blob storage?

and if the upload is the only possible way, are there libraries to achieve that other than Office365-REST-Python-Client?

Vamsi Bitra · Accepted Answer · 2022-12-26 11:56:36Z

1

Unfortunately, you cannot read share point data in azure databricks. SharePoint is not supported source in azure databricks.

More information refer this Article.

Is there any alternative approach ?

yes, there are couple of alternative approaches:

Approach 1: Copy data from SharePoint online list by using azure data factory.
Approach 2: Using Python accessing SharePoint files and data .refer this SO thread by Karthick Mohanraj.

answered Dec 26, 2022 at 11:56

Vamsi Bitra

2,7642 gold badges5 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1