Search depends-on:apache/spark-streaming OR depends-on:apache/spark-graphx OR depends-on:apache/spark-hive OR depends-on:apache/spark-mllib OR depends-on:apache/spark-sql

linkedin/isolation-forest

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.

Scala (JVM): 2.11 2.12

spark linkedin scala outlier-detection machine-learning anomaly-detection unsupervised-learning isolation-forest

67 16 3

leobenkel/zparkio

Boiler plate framework to use Spark and ZIO together.

Scala (JVM): 2.11

spark boiler-plate scala zio functional-programming helpers template

54 11 1

infinispan/infinispan-spark

Infinispan Spark Connector

Scala (JVM): 2.10 2.11 2.12

21 11 5

databricks/spark-xml

XML data source for Spark SQL and DataFrames

Scala (JVM): 2.10 2.11 2.12

286 157 17

stratio/spark-mongodb

Spark library for easy MongoDB access

Scala (JVM): 2.10 2.11

294 96 23

transcendent-ai-labs/dynaml

Scala Library/REPL for Machine Learning Research

Scala (JVM): 2.11

regression machine-learning-api tensorflow kernel-methods scala-library committee-models classification gaussian-processes scala machine-learning repl machine-learning-algorithms

161 45 4

lucacanali/sparkmeasure

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark workload metrics data.

Scala (JVM): 2.11 2.12

spark apache-spark spark-troubleshooting performance-metrics performance-troubleshooting

285 62 7

chermenin/spark-states

Custom state store providers for Apache Spark

Scala (JVM): 2.11 2.12

state-store spark stateful apache-spark spark-structured-streaming structured-streaming apache state spark-streaming

53 17 3

springml/spark-sftp

Spark connector for SFTP

Scala (JVM): 2.10 2.11

48 41 6

datamindedbe/lighthouse

Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines and apply best practices.

Scala (JVM): 2.11

data-lake

46 6 13

coxautomotivedatasolutions/waimak

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

Scala (JVM): 2.11 2.12

spark hadoop data-engineering scala

46 10 8

deeplearning4j/datavec

ETL Library for Machine Learning - data pipelines, data munging and wrangling

Scala (JVM): 2.10 2.11

spark writables hadoop-ecosystem schema machine-learning pipeline svmlight data-munging transformations formatter datapipeline etl

219 162 37

allwefantasy/pyjava

This library is an ongoing effort towards bringing the data exchanging ability between Java/Scala and Python. PyJava introduces Apache Arrow as the exchanging data format.

Scala (JVM): 2.11 2.12