aliyun/aliyun-emapreduce-datasources   2.2.0

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

alexarchambault/ammonite-spark   0.13.12

Run spark calculations from Ammonite

minio/spark-select   2.1

A library for Spark DataFrame using MinIO Select API

saurfang/sbt-spark-submit   0.0.4

sbt plugin for spark-submit

microsoft/mobius   2.0.200

C# and F# language binding and extensions to Apache Spark

helgeho/archivespark   3.0

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

chermenin/spark-states   0.2

Custom state store providers for Apache Spark

galliaproject/gallia-core   0.6.1

A schema-aware Scala library for data transformation

sansa-stack/sansa-stack   0.9.5

Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/

kakao/cuesheet   0.10.0

A framework for writing Spark 2.x applications in a pretty way

azure/azure-kusto-spark   7.0.6

Apache Spark Connector for Azure Kusto

simplexspatial/osm4scala   1.0

Scala and Spark library focused on reading OpenStreetMap Pbf files.

hablapps/doric   0.0.8

Type safety for spark columns

dwestheide/kontextfrei   0.7.0

Writing application logic for Spark jobs that can be unit-tested without a SparkContext

jelmerk/hnswlib   1.2.1

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

coxautomotivedatasolutions/waimak   2.9.7

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

swoop-inc/spark-records   3.0.1

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

em3s/spark-annoy   0.1.5

Building Annoy Index on Apache Spark

samelamin/spark-bigquery   0.2.7

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

cerndb/sparkplugins   0.4

Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are initialized. This also allows extending the Spark metrics systems with user-provided monitoring probes.