apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

delta-io/delta

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

spark-jobserver/spark-jobserver

REST job server for Apache Spark

datastax/spark-cassandra-connector

DataStax Spark Cassandra Connector

holdenk/spark-testing-base

Base classes to use when writing tests with Spark

allwefantasy/mlsql

The Programming Language Designed For Big Data and AI

snappydatainc/snappydata

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

cloudera/livy

Livy is an open source REST interface for interacting with Apache Spark from anywhere

microsoft/mobius

C# and F# language binding and extensions to Apache Spark

databricks/spark-redshift

Redshift data source for Apache Spark

nvidia/spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

hydrospheredata/mist

Serverless proxy for Spark cluster

microsoft/hyperspace

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

sparklinedata/spark-druid-olap

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

crealytics/spark-excel

A Spark plugin for reading Excel files via Apache POI

databricks/spark-sql-perf

leobenkel/zparkio

Boiler plate framework to use Spark and ZIO together.

swoop-inc/spark-alchemy

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

snowflakedb/spark-snowflake

Snowflake Data Source for Apache Spark.

apache/incubator-livy

Mirror of Apache livy (Incubating)