apache/spark   4.1.1

Apache Spark - A unified analytics engine for large-scale data processing

delta-io/delta   4.1.0

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

microsoft/synapseml   1.1.2

Simple and Distributed Machine Learning

spark-jobserver/spark-jobserver   0.12.0

REST job server for Apache Spark

johnsnowlabs/spark-nlp   6.3.3

State of the Art Natural Language Processing

salesforce/transmogrifai   0.7.0

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

zio/zio-quill   3.2.0

Compile-time Language Integrated Queries for Scala

apache/cassandra-spark-connector   1.1.2

Apache Spark to Apache Cassandra connector

apache/kyuubi   1.11.0

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

almond-sh/almond   0.14.5

A Scala kernel for Jupyter

combust/mleap   0.24.0

MLeap: Deploy ML Pipelines to Production

bigdatagenomics/adam   0.23.0

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

typelevel/frameless   0.16.0

Expressive types for Spark.

redislabs/spark-redis   3.1.0

A connector for Spark that allows reading and writing to/from Redis cluster

tibcosoftware/snappydata   0.5

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

mrpowers-io/spark-daria   1.2.3

Essential Spark extensions and helper methods ✨😲

nvidia/spark-rapids   25.12.0

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

delta-io/delta-sharing   1.3.10

An open protocol for secure data sharing

lucacanali/sparkmeasure   0.27

This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simplifies collecting, aggregating, and exporting Spark task/stage metrics, and is designed for practical use by developers and data engineers in interactive analysis, testing, and production monitoring workflows.

h2oai/sparkling-water   2.4.13

Sparkling Water provides H2O functionality inside Spark cluster