Search depends-on:apache/spark-streaming OR depends-on:apache/spark-graphx OR depends-on:apache/spark-hive OR depends-on:apache/spark-mllib OR depends-on:apache/spark-sql

Page 5 of 357 results

allwefantasy/pyjava

This library is an ongoing effort towards bringing the data exchanging ability between Java/Scala and Python. PyJava introduces Apache Arrow as the exchanging data format.

Scala (JVM): 2.11 2.12

20 4 1
sabeegrewal/spark-eventhubs

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Scala (JVM): 2.10 2.11

63 54 18
databricks/spark-xml

XML data source for Spark SQL and DataFrames

Scala (JVM): 2.10 2.11 2.12

308 175 19
lucacanali/sparkmeasure

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

Scala (JVM): 2.11 2.12

spark-troubleshooting spark performance-metrics apache-spark performance-troubleshooting

323 74 7
amplab/ml-matrix

Distributed Matrix Library

Scala (JVM): 2.10 2.11

67 36 4
linkedin/isolation-forest

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.

Scala (JVM): 2.11 2.12

anomaly-detection scala outlier-detection unsupervised-learning machine-learning spark isolation-forest linkedin

67 16 3
datamindedbe/lighthouse

Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines and apply best practices.

Scala (JVM): 2.11

data-lake

51 7 14
stratio/spark-mongodb

Spark library for easy MongoDB access

Scala (JVM): 2.10 2.11

294 96 23
chermenin/spark-states

Custom state store providers for Apache Spark

Scala (JVM): 2.11 2.12

spark-streaming state-store stateful spark-structured-streaming apache spark apache-spark structured-streaming state

53 17 3
springml/spark-sftp

Spark connector for SFTP

Scala (JVM): 2.10 2.11

48 41 6
infinispan/infinispan-spark

Infinispan Spark Connector

Scala (JVM): 2.10 2.11 2.12

21 11 5
coxautomotivedatasolutions/waimak

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

Scala (JVM): 2.11 2.12

spark hadoop data-engineering scala

53 12 8
ebiznext/comet-data-pipeline

Comet Data Pipeline is a Spark Based On Premise and Cloud Ingestion Framework for Batch & Streaming (Coming) Systems

Scala (JVM): 2.11 2.12

20 15 17
transcendent-ai-labs/dynaml

Scala Library/REPL for Machine Learning Research

Scala (JVM): 2.11

classification repl kernel-methods committee-models regression machine-learning-algorithms scala gaussian-processes tensorflow scala-library machine-learning machine-learning-api

161 45 4
tripl-ai/arc

Arc is an opinionated framework for defining data pipelines which are predictable, repeatable and manageable.

Scala (JVM): 2.11 2.12

21 4 6
mrpowers/spark-fast-tests

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)

Scala (JVM): 2.11 2.12

spark testing-framework

218 37 9
deeplearning4j/datavec

ETL Library for Machine Learning - data pipelines, data munging and wrangling

Scala (JVM): 2.10 2.11

formatter etl transformations data-munging pipeline machine-learning datapipeline spark hadoop-ecosystem writables svmlight schema

219 162 37
nerdammer/spark-hbase-connector

Connect Spark to HBase for reading and writing data with ease

Scala (JVM): 2.10

130 60 3
stratio/crossdata

Easy access to big things. Library for Apache Spark extending and improving its capabilities

Scala (JVM): 2.10 2.11

163 49 25
nvidia/spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Scala (JVM): 2.12

171 46 26

1
2
3
4
5 (current)
6
7
8
9
10