fsanaulla/chronicler

Scala toolchain for InfluxDB

sansa-stack/archived-sansa-inference

A general Inference API based on two of the most popular Big Data processing engines: Apache Spark and Apache Flink

univalence/zio-spark

A functional wrapper around Spark to make it works with ZIO

absaoss/spark-hats

Nested array transformation helper extensions for Apache Spark

sansa-stack/archived-sansa-owl

SANSA Stack OWL (Web Ontology Language) API

alonsodomin/sbt-spark

Simple SBT plugin to configure Spark applications

agile-lab-dev/wasp

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

isarn/isarn-sketches-spark

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

starlake-ai/starlake

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

whylabs/whylogs-java

Profile and monitor your ML data pipeline end-to-end

locationtech/rasterframes

Geospatial Raster support for Spark DataFrames

projectnessie/nessie

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

pierrenodet/spark-ensemble

Ensemble Learning for Apache Spark 🌲

cognitedata/cdp-spark-datasource

Spark data source for Cognite Data Fusion

s22s/pre-lt-raster-frames

Spark DataFrames for earth observation data

romans-weapon/spear-framework

Rapid ETL/ELT-connectors/pipeline development leveraged on top of Apache Spark

qubole/streaminglens

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

florentf9/sparkml-som

:sparkles: Spark ML implementation of SOM algorithm (Kohonen self-organizing map)

piotr-kalanski/data-quality-monitoring

Data Quality Monitoring Tool