Search depends-on:apache/spark-core

heartsavior/spark-state-tools

Spark Structured Streaming State Tools

Scala (JVM): 2.11 2.12

apache-spark structured-streaming

22 4 2

tripl-ai/arc

Arc is an opinionated framework for defining data pipelines which are predictable, repeatable and manageable.

Scala (JVM): 2.11 2.12

21 4 6

infinispan/infinispan-spark

Infinispan Spark Connector

Scala (JVM): 2.10 2.11 2.12

21 11 5

ebiznext/comet-data-pipeline

Comet Data Pipeline is a Spark Based On Premise and Cloud Ingestion Framework for Batch & Streaming (Coming) Systems

Scala (JVM): 2.11 2.12

21 15 17

isarn/isarn-sketches-spark

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Scala (JVM): 2.10 2.11 2.12

spark-ml dataframe apache-spark t-digest sketching-algorithm datasets variable-importance pyspark python udaf dataframes dataset data-sketching scala aggregator spark feature-importance data-sketches

20 6 2

nearbydelta/deepspark

A neural network library which trained by Spark RDD instances.

Scala (JVM): 2.10 2.11

20 7 0

indix/sparkplug

Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌

Scala (JVM): 2.10 2.11 2.12

spark spark-sql datapipeline

20 2 8

allwefantasy/pyjava

This library is an ongoing effort towards bringing the data exchanging ability between Java/Scala and Python. PyJava introduces Apache Arrow as the exchanging data format.

Scala (JVM): 2.11 2.12

20 4 1

smart-data-lake/smart-data-lake

Framework to quickly build and maintain Smart Data Lakes

Scala (JVM): 2.11 2.12

smart-data-lake data-pipelines data-lake scala deltalake hadoop spark transform-data hive

19 3 9

bigdatagenomics/utils

General utility code used across BDG products. Apache 2 licensed.

Scala (JVM): 2.10 2.11 2.12

19 25 13

absaoss/spline-spark-agent

Spline agent for Apache Spark

Scala (JVM): 2.11 2.12

19 9 5

fsanaulla/chronicler-spark

InfluxDB connector to Apache Spark on top of Chronicler

Scala (JVM): 2.11 2.12

dataframe chronicler scala spark influxdb streaming rdd

19 1 1

nearbydelta/scalanetwork

A Neural network implementation with Scala

Scala (JVM): 2.10

18 7 1

minio/spark-select

A library for Spark DataFrame using MinIO Select API

Scala (JVM): 2.11

pyspark minio spark-sql parquet-files sbt select bigdata spark amazon-s3

18 1 2

music-of-the-ainur/almaren-framework

The Almaren Framework provides a simplified consistent minimalistic layer over Apache Spark. While still allowing you to take advantage of native Apache Spark features. You can still combine it with standard Spark code.

Scala (JVM): 2.11 2.12