Search depends-on:apache/spark-streaming OR depends-on:apache/spark-graphx OR depends-on:apache/spark-hive OR depends-on:apache/spark-mllib OR depends-on:apache/spark-sql

fsanaulla/chronicler-spark

InfluxDB connector to Apache Spark on top of Chronicler

Scala (JVM): 2.11 2.12

spark dataframe rdd scala influxdb chronicler streaming

19 1 1

51zero/eel-sdk

Big Data Toolkit for the JVM

Scala (JVM): 2.10 2.11 2.12

hive scala etl orc hadoop big-data parquet kafka kudu

117 25 9

music-of-the-ainur/almaren-framework

The Almaren Framework provides a simplified consistent minimalistic layer over Apache Spark. While still allowing you to take advantage of native Apache Spark features. You can still combine it with standard Spark code.

Scala (JVM): 2.11 2.12

spark

18 9 5

syoummer/spatialspark

Big Spatial Data Processing using Spark

Scala (JVM): 2.10 2.11

114 45 6

bigdatagenomics/utils

General utility code used across BDG products. Apache 2 licensed.

Scala (JVM): 2.10 2.11 2.12

19 25 13

audienceproject/spark-dynamodb

Plug-and-play implementation of an Apache Spark custom data source for AWS DynamoDB.

Scala (JVM): 2.11 2.12

107 43 13

skymindio/canova

General Vectorization Lib for Machine Learning Tools

Scala (JVM): 2.10 2.11

104 69 24

zuinnote/hadoopcryptoledger

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Scala (JVM): 2.10 2.11

spark cryptoledger hive flink blockchain ethereum hadoop bitcoin bigdata

103 39 3

helgeho/archivespark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

Scala (JVM): 2.11

spark spark-framework web-archiving archivespark webarchive internet-archive warc

103 13 3

spotify/spark-bigquery

Google BigQuery support for Spark, SQL, and DataFrames

Scala (JVM): 2.10 2.11

101 28 10

delta-io/connectors

Connectors for Delta Lake

Scala (JVM): 2.11 2.12

84 25 6

g-research/spark-dgraph-connector

A connector for Apache Spark and PySpark to Dgraph databases.

Scala (JVM): 2.12

spark pyspark dgraph

10 3 1

mskimm/ann4s

Building Annoy Index on Apache Spark

Scala (JVM): 2.10 2.11

knn scala spark approximate-nearest-neighbor-search

45 8 1

tresata/spark-sorted

Secondary sort and streaming reduce for Apache Spark

Scala (JVM): 2.10 2.11 2.12

73 17 3

rusexpertiza-llc/yupana

BigData analytics platform

Scala (JVM): 2.11 2.12

13 2 4

mindfulmachines/ladydi

Code Less, Build More. Clean, automated Feature Generation and Selection for Apache Spark!

Scala (JVM): 2.11

14 3 1

liquidsvm/liquidsvm

Support vector machines (SVMs) and related kernel-based learning algorithms are a well-known class of machine learning algorithms, for non-parametric classification and regression. liquidSVM is an implementation of SVMs whose key features are: fully integrated hyper-parameter selection, extreme speed on both small and large data sets, full flexibility for experts, and inclusion of a variety of different learning scenarios: multi-class classification, ROC, and Neyman-Pearson learning, and least-squares, quantile, and expectile regression.

Scala (JVM): 2.11