monix/monix-connect

A set of connectors for Monix. 🔛

adform/stream-loader

Components for building stream loaders from Kafka to arbitrary storages

intenthq/pucket

Bucketing and partitioning system for Parquet

agile-lab-dev/wasp

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

starlake-ai/starlake

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

astrolabsoftware/spark-fits

FITS data source for Spark SQL and DataFrames

tapad/sbt-hadoop-oss

An sbt plugin for publishing artifacts to HDFS.

tapad/sbt-oozie-oss

An sbt plugin for launching and scheduling Oozie applications.