Search *

mongodb/mongo-spark

The MongoDB Spark Connector

Scala (JVM): 2.10 2.11 2.12

spark spark-packages connector mongo-spark mongodb

633 278 12

frees-io/freestyle

A cohesive & pragmatic framework of FP centric Scala libraries

Scala (JVM): 2.11 2.12

Scala.js: 0.6

functional-programming architectural-patterns free-monads monads cassandra tagless-final kafka spark scala redis freestyle rpc

616 52 36

cdapio/cdap

An open source framework for building data analytic applications.

Scala (JVM): 2.11 2.12

cdap integration mapreduce java-8 java unified spark dataset python middleware platform spark-streaming

600 296 134

yotpoltd/metorikku

A simplified, lightweight ETL Framework based on Apache Spark

Scala (JVM): 2.11 2.12

sql etl big-data spark scala distributed-computing etl-framework etl-pipeline

460 123 26

spotify/featran

A Scala feature transformation library for data science and machine learning

Scala (JVM): 2.11 2.12 2.13

scio flink ml spark scala xgboost tensorflow scalding data algebird breeze

444 72 20

lucacanali/sparkmeasure

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task and stage metrics data.

Scala (JVM): 2.11 2.12

apache-spark performance-metrics performance-troubleshooting spark-troubleshooting spark

436 103 9

housepower/clickhouse-native-jdbc

ClickHouse Native Protocol JDBC implementation

Scala (JVM): 2.11 2.12

database jdbc tcp-protocol clickhouse-client spark analytics clickhouse

421 134 26

nvidia/spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Scala (JVM): 2.12

big-data gpu rapids spark

378 126 46

deeplearning4j/scalnet

A Scala wrapper for Deeplearning4j, inspired by Keras. Scala + DL + Spark + GPUs

Scala (JVM): 2.10 2.11

deeplearning4j sbt spark nd4j scala deeplearning

344 82 11

microsoft/hyperspace

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Scala (JVM): 2.11 2.12

acceleration spark databases analytics indexing big-data

341 91 18

groupon/sparklint

A tool for monitoring and tuning Spark jobs for efficiency.

Scala (JVM): 2.10 2.11

performance-analysis scala spark

338 85 7

delta-io/delta-sharing

An open protocol for secure data sharing

Scala (JVM): 2.12

data-sharing big-data delta-lake spark pandas

314 60 14

mrpowers/spark-fast-tests

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)

Scala (JVM): 2.11 2.12

spark testing-framework

312 60 12

lightbend/cloudflow

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

Scala (JVM): 2.12 2.13

Sbt: 1.0

kubernetes microservices-architectures streaming-data cloudflow akka streaming-runtimes flink spark streaming-applications

310 88 38

nerdammer/spark-hbase-connector

Connect Spark to HBase for reading and writing data with ease

Scala (JVM): 2.10

hbase spark

295 112 5

hbutani/spark-druid-olap

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

Scala (JVM): 2.10