feathr-ai/feathr   1.0.0

Feathr – A scalable, unified data and AI engineering platform for enterprise

swoop-inc/spark-alchemy   1.2.1

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

setl-framework/setl   1.0.0-SNAPSHOT

A simple Spark-powered ETL framework that just works 🍺

treeverse/lakefs   0.14.1

lakeFS - Data version control for your data lake | Git for data

galliaproject/gallia-core   0.6.1

A schema-aware Scala library for data transformation

coxautomotivedatasolutions/waimak   2.9.7

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

starlake-ai/starlake   1.3.0

Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.

coxautomotivedatasolutions/spark-distcp   0.2.5

A re-implementation of Hadoop DistCP in Apache Spark

vitaliihonta/scala-ql   0.1.0

Data manipulation and reporting for Scala.

prophecy-io/spark-ai   0.1.9

Toolbox for building Generative AI applications on top of Apache Spark.

harrystech/hyppo-worker   0.7.5

The hyppo data ingestion system worker components