Search *

4 results

setl-framework/setl 1.0.0-SNAPSHOT

A simple Spark-powered ETL framework that just works 🍺

Scala versions: 2.12 2.11

data-engineering etl-pipeline etl pipeline data-science spark scala machine-learning setl framework big-data modularization data-transformation dataset data-analysis

181 7
absaoss/hyperdrive 4.7.0

Extensible streaming ingestion pipeline on top of Apache Spark

Scala versions: 2.12 2.11

apache-spark streaming spark-structured-streaming framework pipeline kafka streaming-etl spark ingestion

44 11
prophecy-io/spark-ai 0.1.9

Toolbox for building Generative AI applications on top of Apache Spark.

Scala versions: 2.12

data-engineering generative-ai pipeline spark machine-learning spark-streaming

45 2
torao/quebic 1.0.1

Simple Journaling Queue Library

Scala versions: 2.12 2.11

queue etl java pipeline scala machine-learning

1 1