benfradet/struct-type-encoder

Deriving Spark DataFrame schemas from case classes

azure/azure-kusto-spark

Apache Spark Connector for Azure Kusto

jcdecaux/setl

A simple Spark ETL framework that just works 🍺

zuinnote/spark-hadoopoffice-ds

A Spark datasource for the HadoopOffice library

arangodb/arangodb-spark-connector

lewuathe/dllib

dllib is a distributed deep learning library running on Apache Spark

sansa-stack/sansa-query

SANSA Query Layer

bizreach/aws-kinesis-scala

Scala client for Amazon Kinesis. Also provides write to Kinesis capability for Apache Spark or Spark Streaming.

master/spark-stemming

Spark MLlib wrapper for the Snowball framework

flipkart-incubator/spark-transformers

Spark-Transformers: Library for exporting Apache Spark MLLIB models in to use them in any Java application with no other dependencies.

smart-data-lake/smart-data-lake

Framework to quickly build and maintain Smart Data Lakes

tharwaninitin/etlflow

Functional, Composable library in Scala based on ZIO for writing ETL jobs in AWS and GCP https://tharwaninitin.github.io/etlflow/site/

isarn/isarn-sketches-spark

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

sansa-stack/sansa-owl

SANSA Stack OWL (Web Ontology Language) API

sansa-stack/sansa-inference

A general Inference API based on two of the most popular Big Data processing engines: Apache Spark and Apache Flink

fsanaulla/chronicler

Scala toolchain for InfluxDB

s22s/raster-frames

Spark DataFrames for earth observation data

hydrospheredata/spark-ml-serving

Spark ML Lib serving library

indix/sparkplug

Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌

agile-lab-dev/darwin

Avro Schema Evolution made easy