hammerlab/spark-util

low-level helpers for Apache Spark libraries and tests

noamshaish/containers

mskimm/ann4s

Building Annoy Index on Apache Spark

recipegrace/biglibrary

caskdata/cdap

An open source framework for building data analytic applications.

pierrenodet/spark-ensemble

Ensemble Estimators for Apache Spark ML

getquill/quill

Compile-time Language Integrated Queries for Scala

coxautomotivedatasolutions/vegalite4s

Vega-Lite4s is a small library over the comprehensive Vega-Lite Javascript visualisation library, allowing you to create beautiful Vega-Lite visualisations in Scala

cognitedata/cdp-spark-datasource

Spark data source for the Cognite Data Platform

salesforce/transmogrifai

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand tuning

hablapps/sparkoptics

Optics for Spark DataFrames

helgeho/archivespark

An Apache Spark framework for easy data processing, extraction as well as derivation for Web archives and archival collections, developed by the Internet Archive and L3S Research Center.

kakao/cuesheet

A framework for writing Spark 2.x applications in a pretty way

flipkart-incubator/spark-transformers

Spark-Transformers: Library for exporting Apache Spark MLLIB models in to use them in any Java application with no other dependencies.

ponkin/bloom

Probabilistic data structures java implementation.

deeplearning4j/nd4j

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

yotpoltd/metorikku

A simplified, lightweight ELT Framework based on Apache Spark

sansa-stack/sansa-rdf

SANSA RDF Library

microsoft/mobius

C# and F# language binding and extensions to Apache Spark

log0ymxm/spark-mapper

Spark based implementation of the Topological Mapper algorithm