helena / spark-cassandra

Licence: Apache-2.0 license

An Akka Extension for easy integration of spark and cassandra in Akka micro services.

Programming Languages

5932 projects

spark-cassandra

NOTE: Work stoped on this for now - no time until later in October and I have the scala driver out :)

An Akka Extension for easy integration of Spark and Cassandra in Akka micro services, etc.

Spark Streaming is currently being added to the existing SparkContext option. I am also adding it to cassandra-driver-spark

Full documentation coming, this project is still being developed, but for now:

Usage:

Configuration

Coming soon.

Basic Usage for Spark

Where system is the the existing ActorSystem

val extension = SparkCassandra(system)
import extension._

val data = 1 to 10000
val results = spark.parallelize(data)
  .filter(_ < 10)
  .collect()

Basic Usage for Cassandra

Coming Soon.

Easy Integration of Spark and Cassandra in Akka