zio/zio-protoquill   4.8.6

Quill for Scala 3

projectglow/glow   2.0.0

An open-source toolkit for large-scale genomic analysis

swoop-inc/spark-alchemy   1.2.1

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

benfradet/spark-kafka-writer   0.6.0

Write your Spark data to Kafka seamlessly

linkedin/isolation-forest   3.2.7

A distributed Spark/Scala implementation of the isolation forest algorithm for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.

aws/sagemaker-spark   spark_2.4.0-1.4.2.dev0

A Spark library for Amazon SageMaker.

setl-framework/setl   1.0.0-SNAPSHOT

A simple Spark-powered ETL framework that just works 🍺

azure/azure-cosmosdb-spark   3.7.0

Apache Spark Connector for Azure Cosmos DB

clickhouse/spark-clickhouse-connector   0.8.1

Spark ClickHouse Connector build on DataSourceV2 API

leobenkel/zparkio   0.10.0

Boiler plate framework to use Spark and ZIO together.

sparkling-graph/sparkling-graph   0.0.7

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

clustering4ever/clustering4ever   0.11.0

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

g-research/spark-extension   1.0.0

A library that provides useful extensions to Apache Spark and PySpark.

qubole/kinesis-sql   1.2.0_spark-2.4

Kinesis Connector for Structured Streaming

zouzias/spark-lucenerdd   0.4.0

Spark RDD with Lucene's query and entity linkage capabilities

streamnative/pulsar-spark   2.4.5

Spark Connector to read and write with Pulsar

smart-data-lake/smart-data-lake   2.7.1

Smart Automation Tool for building modern Data Lakes and Data Pipelines

alexarchambault/ammonite-spark   0.13.12

Run spark calculations from Ammonite

aliyun/aliyun-emapreduce-datasources   2.2.0

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

indix/schemer   0.4.3

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.