Search *

20 results

apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

Scala (JVM): 2.10 2.11 2.12

big-data jdbc r scala python spark java sql

30169 24098 330
apache/flink

Apache Flink

Scala (JVM): 2.10 2.11 2.12

scala java big-data flink

13905 7562 277
catboost/catboost

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Scala (JVM): 2.11 2.12

gbdt tutorial gpu-computing gbm big-data categorical-features cuda catboost data-science python gpu data-mining kaggle coreml r machine-learning gradient-boosting decision-trees

5885 898 165
h2oai/h2o-3

Open Source Fast Scalable Machine Learning Platform For Smarter Applications: Deep Learning, Gradient Boosting & XGBoost, Random Forest, Generalized Linear Modeling (Logistic Regression, Elastic Net), K-Means, PCA, Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Scala (JVM): 2.10 2.11

naive-bayes multi-threading data-science python gpu spark ensemble-learning random-forest pca java gbm automl big-data h2o hadoop deep-learning r machine-learning opensource distributed

4777 1723 132
delta-io/delta

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

Scala (JVM): 2.11 2.12

spark acid big-data analytics

3306 776 98
apache/parquet-mr

Apache Parquet

Scala (JVM): 2.10 2.12

parquet java big-data

1282 1071 139
apache/samza

Mirror of Apache Samza

Scala (JVM): 2.10 2.11 2.12

scala big-data samza

671 279 120
yotpoltd/metorikku

A simplified, lightweight ETL Framework based on Apache Spark

Scala (JVM): 2.11 2.12

etl-framework etl sql big-data distributed-computing scala etl-pipeline spark

386 99 23
nvidia/spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Scala (JVM): 2.12

spark gpu rapids big-data

295 83 36
hydrospheredata/mist

Serverless proxy for Spark cluster

Scala (JVM): 2.10 2.11 2.12

apache-spark api big-data serverless

247 59 24
microsoft/hyperspace

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Scala (JVM): 2.11 2.12

acceleration big-data analytics indexing databases spark

215 46 15
51zero/eel-sdk

Big Data Toolkit for the JVM

Scala (JVM): 2.10 2.11 2.12

hive kafka etl big-data hadoop scala kudu orc parquet

117 25 9
locationtech-labs/geopyspark

GeoTrellis for PySpark

Scala (JVM): 2.11

geotrellis big-data python tile-server geospatial spark

95 29 7
clustering4ever/clustering4ever

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

Scala (JVM): 2.11

artificial-intelligence clustering-evaluation scala ai clustering bigdata big-data clustering-algorithm spark scalability

90 11 5
sparkling-graph/sparkling-graph

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Scala (JVM): 2.10 2.11

graph-algorithms network-analysis dsl coarsing big-data graph measure machine-learning approximation spark vertex link-predication heuristics comunity-detection-methods

88 20 4
setl-framework/setl

A simple Spark-powered ETL framework that just works 🍺

Scala (JVM): 2.11 2.12

etl pipeline big-data dataset machine-learning etl-pipeline data-transformation scala data-engineering setl data-science framework spark modularization data-analysis

79 21 5
swoop-inc/spark-records

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

Scala (JVM): 2.12

big-data sparksql spark-records scala spark swoop apache-spark

58 14 4
setl-developers/setl

A simple Spark-powered ETL framework that just works 🍺

Scala (JVM): 2.11 2.12

etl pipeline big-data dataset machine-learning etl-pipeline data-transformation scala data-engineering setl data-science framework spark modularization data-analysis

46 16 5
jcdecaux/setl

A simple Spark ETL framework that just works 🍺

Scala (JVM): 2.11 2.12

etl pipeline big-data dataset machine-learning etl-pipeline data-transformation scala data-engineering setl data-science framework spark modularization data-analysis

30 10 4
diana-hep/spark-root

Apache Spark Data Source for ROOT File Format

Scala (JVM): 2.11

histogrammar big-data root scala python spark

13 9 3