Azure Data Lake - Creating U-SQL External Data Source from connection string

Question

How to create U-SQL Data Source with connection string ?

This is my attempt, it has issue in setting the CREDENTIAL parameter.

CREATE DATA SOURCE MyAzureSQLDBDataSource
FROM AZURESQLDB
WITH
(
    PROVIDER_STRING = "Database=mySampleDB;",
    CREDENTIAL = "Server=mySampleDB.database.windows.net;User ID=myUser;Password=myPasswd",
    REMOTABLE_TYPES = (bool, byte, sbyte, short, ushort, int, uint, long, ulong, decimal, float, double, string, DateTime)
);

Error message:

error External0: E_CSC_USER_INVALIDDATASOURCEOPTIONVALUE: Invalid value '"Server=mySampleDB.database.windows.net;User ID=myUser;Password=myPasswd"' for data source option 'CREDENTIAL'.
Description:
The only valid values for 'CREDENTIAL' are identifiers or two-part identifiers.
Resolution:
Use a valid value.

David Paul Giroux · Accepted Answer · 2018-04-06 23:31:24Z

2

Have you reviewed CREATE DATA SOURCE (U-SQL)?

answered Apr 6, 2018 at 23:31

David Paul Giroux

6574 silver badges10 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Jeson Martajaya Over a year ago

I did. This documentation does not explain about creating data source from connection string.

Michael Rys Over a year ago

Look at the example. The documentation clearly states that you have to create the credential (which contains the connection string) outside of the U-SQL script.

Michael Rys · Accepted Answer · 2018-04-07 01:30:46Z

1

To expand on David's answer.

Since U-SQL scripts are stored at least temporarily in the cluster, we cannot allow the inclusion of secrets in the script. Instead, you need to create the credential in the metadata via an Azure PowerShell command (or SDK) and then refer to that credential in the CREATE DATA SOURCE statement. The documentation link provided by David contains some examples.

answered Apr 7, 2018 at 1:30

Michael Rys

6,68417 silver badges23 bronze badges

6 Comments

Jeson Martajaya Over a year ago

Is there a way to create the credential from csharp ?

Michael Rys Over a year ago

There is a way to use the ADLA SDK to create the credential (learn.microsoft.com/en-us/azure/data-lake-analytics/…). Note that this has to be run outside of a U-SQL script since it does not allow accessing REST end points.

Jeson Martajaya Over a year ago

Argh, the CREATE CREDENTIAL statement is deprecated.. msdn.microsoft.com/en-us/azure/data-lake-analytics/u-sql/…

Jeson Martajaya Over a year ago

Is there an example for creating DATA SOURCE with ADO.NET ?

Jeson Martajaya Over a year ago

If PROVIDER_STRING fully accepts ADO.NET connection string, and CREDENTIAL parameter optional, Azure DataLake will become a very powerful ETL tool. msdn.microsoft.com/en-us/azure/data-lake-analytics/u-sql/…

|

Collectives™ on Stack Overflow

Azure Data Lake - Creating U-SQL External Data Source from connection string

2 Answers 2

2 Comments

6 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

6 Comments

Your Answer

Sign up or log in

Post as a guest

Related