apache/spark

Apache Spark

deeplearning4j/nd4j

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

akka/reactive-kafka

Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

apache/incubator-hudi

Upserts And Incremental Processing on Big Data

snappydatainc/snappydata

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

locationtech/geomesa

GeoMesa is a suite of tools for working with big geo-spatial data in a distributed fashion.

apache/samza

Mirror of Apache Samza

gearpump/gearpump

Lightweight real-time big data streaming engine over Akka

twitter/storehaus

Storehaus is a library that makes it easy to work with asynchronous key value stores

druid-io/tranquility

Tranquility helps you send real-time event streams to Druid and handles partitioning, replication, service discovery, and schema rollover, seamlessly and without downtime.

manub/scalatest-embedded-kafka

A library that provides an in-memory Kafka instance to run your tests against.

cakesolutions/scala-kafka-client

Scala helper modules for operating the Apache Kafka client library (0.9.x - 1.0.x)

krasserm/akka-analytics

Large-scale event processing with Akka Persistence and Apache Spark

krasserm/akka-persistence-kafka

A replicated Akka Persistence journal backed by Apache Kafka

sclasen/akka-kafka

lightbend/kafka-streams-scala

Thin Scala wrapper around Kafka Streams Java API

cjdev/kafka-rx

reactive kafka client

jpzk/mockedstreams

Scala DSL for Unit-Testing Processing Topologies in Kafka Streams

ovotech/fs2-kafka

Functional Kafka Streams for Scala

tresata/spark-kafka

Low level integration of Spark and Kafka