heartsavior/spark-state-tools

Spark Structured Streaming State Tools

jongwook/spark-ranking-metrics

Offline Recommender System Evaluation for Spark

tharwaninitin/etlflow

Functional, Composable library in Scala based on ZIO for writing ETL jobs in AWS and GCP https://tharwaninitin.github.io/etlflow/site/

EMCECS/spark-ecs-s3

ECS connector for Apache Spark

minio/spark-select

A library for Spark DataFrame using MinIO Select API

sansa-stack/sansa-datalake

A library to query heterogeneous data sources uniformly using SPARQL

itspawanbhardwaj/spark-fuzzy-matching

Fuzzy matching function in spark (https://spark-packages.org/package/itspawanbhardwaj/spark-fuzzy-matching)

tripl-ai/arc-jupyter

Arc-Jupyter is an interactive Jupyter Notebooks Extenstion for building Arc data pipelines via Jupyter Notebooks.

yugabyte/spark-cassandra-connector

YugabyteDB Spark Connector for YCQL, based on the DataStax Connector

cognitedata/cdp-spark-datasource

Spark data source for Cognite Data Fusion

cookieai/cookie-datasets

Read well-known ML datasets in Apache Spark

cecca/graphx-diameter

A spark package to approximate the diameter of large graphs

sigopt/sigopt-spark

geotrellis/maml

Map Algebra Modeling Language: It's what we and whales are.

catalystcode/streaming-instagram

A library for reading social data from Instagram using Spark Streaming.

diana-hep/spark-root

Apache Spark Data Source for ROOT File Format

iaja/scalaldavis

Scala-Spark port of https://github.com/bmabey/pyLDAvis for Apache Spark LDA Topic Modelling Visualisation

lloydmeta/sparkka-streams

Power a Spark Stream from anywhere in your Akka Stream Flow

zuinnote/spark-hadoopcryptoledger-ds

A Spark datasource for the HadoopCryptoLedger library

iheartradio/thomas

Another A/B test library