What could be the best way to automatize the following process in Azure:
- Run PowerShell script
- Store the output (.csv or .tsv) directly in ADLS (or in a StorageAccount and copy them to ADLS)
- Move data from ADLS to one Azure SQL DB
For points 2 and 3 think that the best way is to implement them in ADF with copy activity and some U-SQL scripts.
For point 1 I don’t have a clear idea how to implement it. I’m considering a Custom Activity in ADF or implement it on Azure Automation. Which method is more appropriate for this purpose?