spotify/scio

A Scala API for Apache Beam and Google Cloud Dataflow.

spotify/featran

A Scala feature transformation library for data science and machine learning

spotify/ratatool

A tool for data sampling, data generation, and data diffing

spotify/spark-bigquery

Google BigQuery support for Spark, SQL, and DataFrames

spotify/noether

Scala Aggregators used for ML Model metrics monitoring

spotify/magnolify

A collection of Magnolia add-on modules

spotify/flo

A lightweight workflow definition library

spotify/dbeam

DBeam extracts SQL tables using JDBC and Apache Beam

spotify/hype

Runs JVM closures in Docker containers on Kubernetes

spotify/elitzur

spotify/tfexample-derive

Provides compile-time derivation of conversions between Scala case classes and Tensorflow Example protocol buffers

spotify/scio-contrib

Community-supported add-ons for Scio