Issues with executing multiple queries using Spark and HiveSQL

Question

Within spark-shell where if I attempt something like below:

var sqlContext = new org.apache.spark.sql.hive.HiveContext(sc) 

var query = "select * from myDB.table limit 10; drop table if exists"

var queryDF = sqlContext.sql(query)

I receive an error:

org.apache.spark.sql.AnlysisException: missing EOF at ';'....

I can execute simple simple single line queries just fine but multi-command queries always result in this error.

Has anyone ran into and solved this problem?

zero323 · Accepted Answer · 2015-11-05 20:43:24Z

5

It is an expected behavior. SQLContext.sql doesn't support multiple queries so solution is pretty simple - pass only a single query at the time.

answered Nov 5, 2015 at 20:43

zero323

331k108 gold badges981 silver badges958 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Thomas Decaux Over a year ago

Is it a bug from Spark SQL parser? Because this is possible with Hive already.

Collectives™ on Stack Overflow

Issues with executing multiple queries using Spark and HiveSQL

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related