Querying Cassandra data using Spark SQL in Java

Question

For Querying Cassandra data using Spark SQL in Java, I come across 2 documentation from datastax with version 4.6 and 5.0

The documentation for 5.0 recommends HiveContext while 4.6 docs recommends CassandraSQLContext . Which one should i use ? I am using Apache Cassandra 3.9

if you are using apache cassandra, you must have installed spark... DSE 4.6 comes with spark 1.4.x while DSE 5.0 comes with 1.6.x. In case you are using spark 2.0 then SQLContext and Hivecontext are bundled into sparksession — undefined_variable
– undefined_variable, Commented Mar 27, 2017 at 9:21
I am using spark 2.1. Can you please point me to an example please ? — Vinod Jayachandran
– Vinod Jayachandran, Commented Mar 27, 2017 at 9:23
spark.apache.org/docs/latest/…... spark.apache.org/docs/latest/… — undefined_variable
– undefined_variable, Commented Mar 27, 2017 at 9:29

mariusz-s · Accepted Answer · 2017-03-27 08:48:50Z

1

I think that if your are going to use 5.0 version there will be not CassandraSQLContext - it was removed since 4.7.

answered Mar 27, 2017 at 8:48

mariusz-s

1,7662 gold badges13 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Vinod Jayachandran Over a year ago

What if I am using Apache Cassandra 3.9 ?

mariusz-s Over a year ago

It depends on which version of DataStax Enterprise you use - do you have any or you have cassandra standalone? if cassandra and spark are standalone try to follow coderwall.com/p/o9bkjg/setup-spark-with-cassandra-connector (module developed by DataStax) using only spark-cassandra-connector

Collectives™ on Stack Overflow

Querying Cassandra data using Spark SQL in Java

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related