indix/schemer

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

tresata/spark-wordtophrase

Spark RDD based implementation of word2phrase algorithm

bigdatagenomics/quinine

A refreshing treatment for all quality control ailments. Apache 2 licensed.

zuinnote/hadoopcryptoledger

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

histogrammar/histogrammar-scala

Scala implementation of Histogrammar, with optional front-ends and back-ends as separate Maven projects.

crealytics/spark-google-analytics

A Spark package for retrieving data from Google Analytics

aerospike/aerospark

quantarray/skylark

Collection of libraries for quantitative and financial computation.

jparkie/spark2cassandra

Spark Library for Bulk Loading into Cassandra

jparkie/spark2elasticsearch

Spark Library for Bulk Loading into Elasticsearch

diana-hep/spark-root

Apache Spark Data Source for ROOT File Format

thoughtworksinc/spark-flatter

A library that converts between nested DataSets and flatten DataFrames

springml/spark-salesforce

Spark data source for Salesforce

luqmansahaf/play-livy-module

A Play Module for running Livy Job, that runs code on remote Spark Session.

spotify/spark-bigquery

Google BigQuery support for Spark, SQL, and DataFrames

keedio/spark-csv

CSV data source for Spark SQL and DataFrames

holdenk/spark-validator

A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support.

piotr-kalanski/data-quality-monitoring

Data Quality Monitoring Tool

springml/spark-workday

Spark data source for Workday

srapisarda/stypes