heartsavior/spark-state-tools

Spark Structured Streaming State Tools

jongwook/spark-ranking-metrics

Offline Recommender System Evaluation for Spark

cecca/graphx-diameter

A spark package to approximate the diameter of large graphs

tharwaninitin/etlflow

Functional, Composable library in Scala based on ZIO for writing ETL jobs in AWS and GCP https://tharwaninitin.github.io/etlflow/site/

iaja/scalaldavis

Scala-Spark port of https://github.com/bmabey/pyLDAvis for Apache Spark LDA Topic Modelling Visualisation

minio/spark-select

A library for Spark DataFrame using MinIO Select API

ozancicek/artan

Online latent state estimation with Spark

catalystcode/streaming-instagram

A library for reading social data from Instagram using Spark Streaming.

sigopt/sigopt-spark

itspawanbhardwaj/spark-fuzzy-matching

Fuzzy matching function in spark (https://spark-packages.org/package/itspawanbhardwaj/spark-fuzzy-matching)

appsflyer-dev/spark-bigquery

Spark connector for BigQuery

wtog/web-crawler

web crawler

absaoss/jdbc2s

A JDBC streaming source for Spark

catalystcode/streaming-facebook

A library for reading social data from Facebook using Spark Streaming.

enriquegrodrigo/spark-crowd

A package for dealing with crowdsourced big data.

histogrammar/histogrammar-scala

Scala implementation of Histogrammar, with optional front-ends and back-ends as separate Maven projects.

lloydmeta/sparkka-streams

Power a Spark Stream from anywhere in your Akka Stream Flow

diana-hep/spark-root

Apache Spark Data Source for ROOT File Format

zuinnote/spark-hadoopcryptoledger-ds

A Spark datasource for the HadoopCryptoLedger library

sadikovi/spark-netflow

NetFlow data source for Spark SQL and DataFrames