synsys / spark

Apache Spark Extensions

GitHub

Apache Spark Extensions

A multi-module Maven project. Each module extends the core functionality of Apache Spark as described below.

Modules

Overview groupId artifactId packaging
Parent module com.synsys.org.apache.spark spark pom
A Spark Streaming module that ingests data from an Apache Camel component. Any of the many Apache Camel components supporting message consumption can be used com.synsys.org.apache.spark spark-streaming-camel_2.10 jar

Building

Builds require maven version 3.1.1 or higher.

From a command line run:

cd /project/root
mvn install

Releases

Released artifacts are deployed to Maven Central

Documentation

The package.scala and package.info files in each package provide an overview for Scala and Java languages respectively. For more detail see the class comments.

The associated Scala and Java unit tests provide working code examples that can be used as templates for your own endeavours.

Documentation

libraryDependencies += "com.synsys.org.apache.spark" %% "spark-streaming-camel" % "1.0.0"
Ammonite REPL 
import $ivy.`com.synsys.org.apache.spark::spark-streaming-camel:1.0.0`
<dependency>
  <groupId>com.synsys.org.apache.spark</groupId>
  <artifactId>spark-streaming-camel_2.10</artifactId>
  <version>1.0.0</version>
</dependency>
compile group: 'com.synsys.org.apache.spark', name: 'spark-streaming-camel_2.10', version: '1.0.0'
Mill build tool 
ivy"com.synsys.org.apache.spark::spark-streaming-camel:1.0.0"
Try online with Scastie
Try on Scastie

Statistics

Contributors

License

6 Dependencies

Java Dependencies