agile-lab-dev/darwin   1.2.2

Avro Schema Evolution made easy

music-of-the-ainur/almaren-framework   0.9.11-3.5

The Almaren Framework provides a simplified consistent minimalistic layer over Apache Spark. While still allowing you to take advantage of native Apache Spark features. You can still combine it with standard Spark code.

sansa-stack/archived-sansa-query   0.7.1

SANSA Query Layer

intenthq/pucket   1.7.3

Bucketing and partitioning system for Parquet

indix/sparkplug   0.2.0

Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌

agile-lab-dev/wasp   2.35.0

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

fsanaulla/chronicler   0.7.2

Scala toolchain for InfluxDB

fsanaulla/chronicler-spark   0.6.0

InfluxDB connector to Apache Spark on top of Chronicler

sansa-stack/archived-sansa-inference   0.7.1

A general Inference API based on two of the most popular Big Data processing engines: Apache Spark and Apache Flink

weaviate/spark-connector   1.3.2

Weaviate connector for Apache Spark

sansa-stack/archived-sansa-owl   0.7.1

SANSA Stack OWL (Web Ontology Language) API

alonsodomin/sbt-spark   0.6.0

Simple SBT plugin to configure Spark applications

locationtech/rasterframes   0.11.1

Geospatial Raster support for Spark DataFrames

whylabs/whylogs-java   0.1.3

Profile and monitor your ML data pipeline end-to-end

isarn/isarn-sketches-spark   0.6.0-sp3.2

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

absaoss/pramen   1.9.2

Resilient data pipeline framework running on Apache Spark

pierrenodet/spark-ensemble   0.9.1

Ensemble Learning for Apache Spark 🌲

cognitedata/cdp-spark-datasource   3.20.1131

Spark data source for Cognite Data Fusion

kotlin/kotlin-spark-api   1.2.4

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x