apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

apache/flink

Apache Flink

apache/incubator-predictionio

PredictionIO, a machine learning server for developers and ML engineers. Built on Apache Spark, HBase and Spray.

twitter/scalding

A Scala API for Cascading

getquill/quill

Compile-time Language Integrated Queries for Scala

spotify/scio

A Scala API for Apache Beam and Google Cloud Dataflow.

twitter/summingbird

Streaming MapReduce with Scalding and Storm

snappydatainc/snappydata

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

twitter/bijection

Reversible conversions between types

twitter/chill

Scala extensions for the Kryo serialization library

spotify/featran

A Scala feature transformation library for data science and machine learning

druid-io/tranquility

Tranquility helps you send real-time event streams to Druid and handles partitioning, replication, service discovery, and schema rollover, seamlessly and without downtime.

lightbend/kafka-streams-scala

Thin Scala wrapper around Kafka Streams Java API

twitter/tormenta

Scala extensions for Storm

zenecture/neuroflow

Artificial Neural Networks for Scala

spotify/flo

A lightweight workflow definition library

wellner/jcarafe

lum-ai/odinson

codefeedr/codefeedr

CodeFeedr core infrastructure

azavea/scaliper

Scaliper is a scala microbenchmarking toolkit based on Google Caliper.