A Scala API for Apache Beam and Google Cloud Dataflow.
A tool for data sampling, data generation, and data diffing
Quix Notebook Manager
BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
Shapeless utilities for common data types
A collection of Magnolia add-on modules
Functional, Composable library in Scala based on ZIO for writing ETL jobs in AWS and GCP https://tharwaninitin.github.io/etlflow/site/
ScalikeJDBC extension for Google BigQuery
Community-supported add-ons for Scio
(Script) Generates SQL query that selects all fields (recursively for nested fields) from the provided BigQuery schema file.