sparklinedata/spark-datetime

functionstest

tripl-ai/arc

Arc is an opinionated framework for defining data pipelines which are predictable, repeatable and manageable.

irvingc/dbscan-on-spark

An implementation of DBSCAN runing on top of Apache Spark

karlhigley/spark-neighbors

Spark-based approximate nearest neighbor search using locality-sensitive hashing

clustering4ever/clustering4ever

C4E, a Scala or Spark library for local and distributed Clustering.

syoummer/spatialspark

Big Spatial Data Processing using Spark

51zero/eel-sdk

Big Data Toolkit for the JVM

lloydmeta/metascraper

Scala library for scraping metadata from specified URLs (e.g. OpenGraph)

chubbyjiang/spark_db_connector

Use Scala API to read/write data from different databases,HBase,MySQL,etc.

lewuathe/dllib

dllib is a distributed deep learning library running on Apache Spark

helgeho/archivespark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

zuinnote/hadoopcryptoledger

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

skymindio/canova

General Vectorization Lib for Machine Learning Tools

arangodb/arangodb-spark-connector

spotify/spark-bigquery

Google BigQuery support for Spark, SQL, and DataFrames

master/spark-stemming

Spark MLlib wrapper for the Snowball framework

sansa-stack/sansa-inference

A general Inference API based on two of the most popular Big Data processing engines: Apache Spark and Apache Flink

indix/sparkplug

Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌

rapidsai/xgboost

Fork of dmlc/xgboost for RAPIDS + XGBoost integration

alexarchambault/ammonite-spark

Run spark calculations from Ammonite