A Scala API for Apache Beam and Google Cloud Dataflow.
A tool for data sampling, data generation, and data diffing
Quix Notebook Manager
BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
Shapeless utilities for common data types
Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
A collection of Magnolia add-on modules
ScalikeJDBC extension for Google BigQuery
Functional, Composable library in Scala based on ZIO for writing ETL jobs in AWS and GCP https://tharwaninitin.github.io/etlflow/site/
Community-supported add-ons for Scio
(Script) Generates SQL query that selects all fields (recursively for nested fields) from the provided BigQuery schema file.