Search *

apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

Scala (JVM): 2.10 2.11 2.12

jdbc python spark scala java big-data r sql

27427 22482 330

apache/flink

Apache Flink

Scala (JVM): 2.10 2.11 2.12

scala java big-data flink

13905 7562 277

h2oai/h2o-3

Open Source Fast Scalable Machine Learning Platform For Smarter Applications: Deep Learning, Gradient Boosting & XGBoost, Random Forest, Generalized Linear Modeling (Logistic Regression, Elastic Net), K-Means, PCA, Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Scala (JVM): 2.10 2.11

naive-bayes gpu python deep-learning ensemble-learning spark gbm opensource machine-learning data-science pca automl multi-threading java distributed h2o r random-forest hadoop big-data

4777 1723 132

delta-io/delta

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

Scala (JVM): 2.11 2.12

spark acid big-data analytics

2516 529 65

apache/parquet-mr

Apache Parquet

Scala (JVM): 2.10 2.12

parquet java big-data

1144 992 126

apache/samza

Mirror of Apache Samza

Scala (JVM): 2.10 2.11 2.12

scala big-data samza

641 271 119

yotpoltd/metorikku

A simplified, lightweight ETL Framework based on Apache Spark

Scala (JVM): 2.11 2.12

sql etl-framework etl-pipeline etl spark scala big-data distributed-computing

278 71 21

hydrospheredata/mist

Serverless proxy for Spark cluster

Scala (JVM): 2.10 2.11 2.12

apache-spark api big-data serverless

247 59 24

microsoft/hyperspace

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Scala (JVM): 2.11 2.12

databases analytics spark indexing acceleration big-data

131 27 12

51zero/eel-sdk

Big Data Toolkit for the JVM

Scala (JVM): 2.10 2.11 2.12

orc kafka parquet etl kudu scala hive hadoop big-data

117 25 9

locationtech-labs/geopyspark

GeoTrellis for PySpark

Scala (JVM): 2.11

python tile-server spark geospatial geotrellis big-data

95 29 7

sparkling-graph/sparkling-graph

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Scala (JVM): 2.10 2.11

approximation link-predication measure vertex spark dsl machine-learning coarsing heuristics big-data graph-algorithms graph network-analysis comunity-detection-methods

88 20 4

clustering4ever/clustering4ever

C4E, a Scala or Spark library for local and distributed Clustering.

Scala (JVM): 2.11

bigdata scalability clustering-algorithm spark clustering artificial-intelligence ai scala big-data clustering-evaluation

82 8 5

seznam/euphoria

Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.

Scala (JVM): dotty