apache/kyuubi   1.10.0

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

mjakubowski84/parquet4s   2.20.0

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

51zero/eel-sdk   1.2.4

Big Data Toolkit for the JVM

smart-data-lake/smart-data-lake   2.7.1

Smart Automation Tool for building modern Data Lakes and Data Pipelines

aliyun/aliyun-emapreduce-datasources   2.2.0

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

coxautomotivedatasolutions/waimak   2.9.7

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

coxautomotivedatasolutions/spark-distcp   0.2.5

A re-implementation of Hadoop DistCP in Apache Spark

agile-lab-dev/darwin   1.2.2

Avro Schema Evolution made easy

izeigerman/akkeeper   0.4.11

An easy way to deploy your Akka services to a distributed environment.

agile-lab-dev/wasp   2.35.0

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

apache/incubator-wayang   0.7.1

Apache Wayang(incubating) is the first cross-platform data processing system.

romans-weapon/spear-framework   3.1.1-3.0

Rapid ETL/ELT-connectors/pipeline development leveraged on top of Apache Spark

hammerlab/spark-util   3.1.0

low-level helpers for Apache Spark libraries and tests

tapad/sbt-hadoop-oss   0.2.1

An sbt plugin for publishing artifacts to HDFS.

zuinnote/hadoopoffice

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

tapad/sbt-oozie-oss   0.1.0

An sbt plugin for launching and scheduling Oozie applications.

hindog/grid-executor   2.0.7

Library for remote JVM ExecutorService with only dependency being password-less SSH -- Run clustered Hadoop/Spark jobs from IDE -- IDE-pimped Spark shell with full auto-completion!

h2oai/h2o-3   3.30.0.3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

zuinnote/hadoopcryptoledger

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive