apache/spark   3.5.3

Apache Spark - A unified analytics engine for large-scale data processing

apache/flink   1.20.0

Apache Flink

combust/mleap   0.23.2

MLeap: Deploy ML Pipelines to Production

bigdatagenomics/adam   0.23.0

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

apache/sedona   1.6.1

A cluster computing framework for processing large-scale geospatial data

lucacanali/sparkmeasure   0.24

This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spark jobs. It focuses on easing the collection and examination of Spark metrics, making it a practical choice for both developers and data engineers.

scalapy/scalapy   0.5.3

Use the world of Python from the comfort of Scala!

aws/sagemaker-spark   spark_2.4.0-1.4.2.dev0

A Spark library for Amazon SageMaker.

g-research/spark-extension   1.0.0

A library that provides useful extensions to Apache Spark and PySpark.

locationtech-labs/geopyspark   0.3.0

GeoTrellis for PySpark

shadaj/scalapy-tensorflow   0.1.0

Static facades for using TensorFlow in ScalaPy

isarn/isarn-sketches-spark   0.6.0-sp3.2

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

vizierdb/vizier-scala   2.0.1

The Vizier kernel-free notebook programming environment

fqaiser94/mse   0.2.4

Make Structs Easy (MSE)

scalapy/python-native-libs   0.2.4

Helpers for setting up an embedded Python interpreter

ozancicek/artan   0.5.1

Online latent state estimation with Spark

salmon-brain/dead-salmon-brain   0.0.8

Apache Spark based framework for analysis A/B experiments

diana-hep/spark-root   0.1.16

Apache Spark Data Source for ROOT File Format

timvw/adobe-analytics-datafeed-datasource   0.1.0

Apache Spark data source for Adobe Analytics Data Feed

ctongfei/kingscross   0.1.0

Portal from the magical world of Scala to dangerous external interpreters outside JVM