A Scala API for Apache Beam and Google Cloud Dataflow.
A tool for data sampling, data generation, and data diffing
A Scala feature transformation library for data science and machine learning
Google BigQuery support for Spark, SQL, and DataFrames
DBeam extracts SQL tables using JDBC and Apache Beam
Runs JVM closures in Docker containers on Kubernetes
A lightweight workflow definition library
Scala Aggregators used for ML Model metrics monitoring
A collection of Magnolia add-on modules
Provides compile-time derivation of conversions between Scala case classes and Tensorflow Example protocol buffers
Community-supported add-ons for Scio
