Search *

22 results

apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

Scala (JVM): 2.10 2.11 2.12 2.13

big-data jdbc java spark scala sql r python

31029 24612 331
apache/flink

Apache Flink

Scala (JVM): 2.10 2.11 2.12

scala java big-data flink

13905 7562 277
catboost/catboost

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Scala (JVM): 2.11 2.12

catboost tutorial gbm gpu machine-learning decision-trees cuda data-science gbdt gradient-boosting data-mining big-data coreml r python kaggle gpu-computing categorical-features

5986 906 162
h2oai/h2o-3

Open Source Fast Scalable Machine Learning Platform For Smarter Applications: Deep Learning, Gradient Boosting & XGBoost, Random Forest, Generalized Linear Modeling (Logistic Regression, Elastic Net), K-Means, PCA, Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Scala (JVM): 2.10 2.11

big-data java spark random-forest gbm distributed opensource multi-threading gpu deep-learning machine-learning r python automl data-science ensemble-learning h2o pca hadoop naive-bayes

4777 1723 132
delta-io/delta

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

Scala (JVM): 2.11 2.12

spark acid big-data analytics

3306 776 98
apache/parquet-mr

Apache Parquet

Scala (JVM): 2.10 2.12

parquet java big-data

1392 1108 152
apache/samza

Mirror of Apache Samza

Scala (JVM): 2.10 2.11 2.12

scala big-data samza

671 279 120
yotpoltd/metorikku

A simplified, lightweight ETL Framework based on Apache Spark

Scala (JVM): 2.11 2.12

big-data scala sql etl-pipeline spark etl etl-framework distributed-computing

416 107 25
nvidia/spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Scala (JVM): 2.12

spark gpu rapids big-data

336 108 43
hydrospheredata/mist

Serverless proxy for Spark cluster

Scala (JVM): 2.10 2.11 2.12

apache-spark api big-data serverless

247 59 24
delta-io/delta-sharing

An open protocol for secure data sharing

Scala (JVM): 2.12

big-data spark delta-lake pandas data-sharing

219 25 8
microsoft/hyperspace

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Scala (JVM): 2.11 2.12

big-data spark analytics acceleration databases indexing

215 46 15
51zero/eel-sdk

Big Data Toolkit for the JVM

Scala (JVM): 2.10 2.11 2.12

big-data etl scala kudu orc parquet hive kafka hadoop

117 25 9
locationtech-labs/geopyspark

GeoTrellis for PySpark

Scala (JVM): 2.11

big-data spark geotrellis python geospatial tile-server

95 29 7
clustering4ever/clustering4ever

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

Scala (JVM): 2.11

artificial-intelligence clustering-algorithm ai scalability big-data clustering spark clustering-evaluation bigdata scala

90 11 5
sparkling-graph/sparkling-graph

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Scala (JVM): 2.10 2.11

big-data vertex graph-algorithms spark heuristics machine-learning graph dsl approximation comunity-detection-methods network-analysis coarsing measure link-predication

88 20 4
setl-framework/setl

A simple Spark-powered ETL framework that just works 🍺

Scala (JVM): 2.11 2.12

big-data data-analysis scala framework data-engineering data-transformation dataset modularization data-science spark etl pipeline machine-learning etl-pipeline setl

79 21 5
swoop-inc/spark-records

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

Scala (JVM): 2.12

big-data spark scala swoop apache-spark sparksql spark-records

58 14 4
setl-developers/setl

A simple Spark-powered ETL framework that just works 🍺

Scala (JVM): 2.11 2.12

big-data data-analysis scala framework data-engineering data-transformation dataset modularization data-science spark etl pipeline machine-learning etl-pipeline setl

46 16 5
jcdecaux/setl

A simple Spark ETL framework that just works 🍺

Scala (JVM): 2.11 2.12

big-data data-analysis scala framework data-engineering data-transformation dataset modularization data-science spark etl pipeline machine-learning etl-pipeline setl

30 10 4