Search *

Git-like capabilities for your object storage

lakefs git-for-data datalake go apache-sparksql object-storage data-quality apache-spark aws-s3 data-versioning data-engineering golang datalakes google-cloud-storage azure-blob-storage hadoop-filesystem data-lake

1646 172 45

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

spark data-science scala data-engineering

141 23 7

A simple Spark-powered ETL framework that just works 🍺

etl machine-learning setl data-transformation framework modularization scala data-analysis data-engineering data-science etl-pipeline pipeline spark dataset big-data

79 21 5

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

spark hadoop data-engineering scala

64 14 8

A simple Spark-powered ETL framework that just works 🍺

etl machine-learning setl data-transformation framework modularization scala data-analysis data-engineering data-science etl-pipeline pipeline spark dataset big-data

46 16 5

A simple Spark ETL framework that just works 🍺

etl machine-learning setl data-transformation framework modularization scala data-analysis data-engineering data-science etl-pipeline pipeline spark dataset big-data

30 10 4