apache/spark   4.1.1

Apache Spark - A unified analytics engine for large-scale data processing

apache/flink   1.20.3

Apache Flink

combust/mleap   0.24.0

MLeap: Deploy ML Pipelines to Production

bigdatagenomics/adam   0.23.0

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

apache/sedona   1.8.1

A cluster computing framework for processing large-scale geospatial data

lucacanali/sparkmeasure   0.27

This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simplifies collecting, aggregating, and exporting Spark task/stage metrics, and is designed for practical use by developers and data engineers in interactive analysis, testing, and production monitoring workflows.

scalapy/scalapy   0.5.3

Use the world of Python from the comfort of Scala!

aws/sagemaker-spark   spark_2.4.0-1.4.2.dev0

A Spark library for Amazon SageMaker.

g-research/spark-extension   1.0.0

A library that provides useful extensions to Apache Spark and PySpark.

catboost/catboost   1.2.10

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

locationtech-labs/geopyspark   0.3.0

GeoTrellis for PySpark

shadaj/scalapy-tensorflow   0.1.0

Static facades for using TensorFlow in ScalaPy

vizierdb/vizier-scala   2.1.1

The Vizier kernel-free notebook programming environment

isarn/isarn-sketches-spark   0.6.0-sp3.2

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

scalapy/python-native-libs   0.2.5

Helpers for setting up an embedded Python interpreter

fqaiser94/mse   0.2.4

Make Structs Easy (MSE)

jelmerk/hnswlib-spark   1.1.3

Spark library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

salmon-brain/dead-salmon-brain   0.0.8

Apache Spark based framework for analysis A/B experiments

ozancicek/artan   0.5.1

Online latent state estimation with Spark

timvw/adobe-analytics-datafeed-datasource   0.1.0

Apache Spark data source for Adobe Analytics Data Feed