Switch between %python variables and %sql variables in Databricks

Question

I'm trying to switch between %python variables and %sql variables in Databricks SQL notebook.

Let's imagine this situation -

%python 
url_var = 'https://www.example.org/localdata_2020_01_01.csv'

%sql 
SET url_sql_var = $(url_var)
-- This doesn't work as expected

But this doesn't work because I'm not sure how to switch between Python & SQL variables in Databricks SQL notebooks.

Kindly help.

Does this answer your question? How can I access python variable in Spark SQL? — Alex Ott
– Alex Ott, Commented Nov 17, 2021 at 7:31

Karthikeyan Rasipalay Durairaj · Accepted Answer · 2021-11-16 22:43:08Z

-1

this is not possible . this is the way Databricks notebook has been configured . You can check my answer here

answered Nov 16, 2021 at 22:43

Karthikeyan Rasipalay Durairaj

2,33922 silver badges42 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Alex Ott Over a year ago

it's possible, see linked answer

Karthikeyan Rasipalay Durairaj Over a year ago

thanks for your details . I agree on your answer if same variable is being used across multiple cells (%python,%sql). But , consider this scenario . %python cell generating variable , if we want to use it in %sql cell is not possible . thats what my answer .

Collectives™ on Stack Overflow

Switch between %python variables and %sql variables in Databricks

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related