snowflakedb/spark-snowflake

Snowflake Data Source for Apache Spark.

zio/zio-protoquill

Quill for Scala 3

azure/azure-cosmosdb-spark

Apache Spark Connector for Azure Cosmos DB

leobenkel/zparkio

Boiler plate framework to use Spark and ZIO together.

projectglow/glow

An open-source toolkit for large-scale genomic analysis

sparkling-graph/sparkling-graph

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

qbeast-io/qbeast-spark

Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!

zouzias/spark-lucenerdd

Spark RDD with Lucene's query and entity linkage capabilities

clustering4ever/clustering4ever

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

aliyun/aliyun-emapreduce-datasources

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

indix/schemer

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

absaoss/cobrix

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

minio/spark-select

A library for Spark DataFrame using MinIO Select API

streamnative/pulsar-spark

When Apache Pulsar meets Apache Spark

helgeho/archivespark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

saurfang/sbt-spark-submit

sbt plugin for spark-submit

microsoft/mobius

C# and F# language binding and extensions to Apache Spark

chermenin/spark-states

Custom state store providers for Apache Spark

housepower/spark-clickhouse-connector

Spark ClickHouse Connector build on DataSourceV2 API

alexarchambault/ammonite-spark

Run spark calculations from Ammonite