Apache Spark Extensions
A multi-module Maven project. Each module extends the core functionality of Apache Spark as described below.
Modules
| Overview | groupId | artifactId | packaging |
|---|---|---|---|
| Parent module | com.synsys.org.apache.spark | spark | pom |
| A Spark Streaming module that ingests data from an Apache Camel component. Any of the many Apache Camel components supporting message consumption can be used | com.synsys.org.apache.spark | spark-streaming-camel_2.10 | jar |
Building
Builds require maven version 3.1.1 or higher.
From a command line run:
cd /project/root
mvn install
Releases
Released artifacts are deployed to Maven Central
Documentation
The package.scala and package.info files in each package provide an overview for Scala and Java languages respectively. For more detail see the class comments.
The associated Scala and Java unit tests provide working code examples that can be used as templates for your own endeavours.
