A Scala API for Apache Beam and Google Cloud Dataflow.
A tool for data sampling, data generation, and data diffing
BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
Quix Notebook Manager
Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
A collection of Magnolia add-on modules
Shapeless utilities for common data types
Functional, Composable library in Scala based on ZIO for writing ETL jobs in AWS and GCP https://tharwaninitin.github.io/etlflow/site/
ScalikeJDBC extension for Google BigQuery
Community-supported add-ons for Scio
A library to transform basic types and case classes into SQL types and Schemas from different database, making possible to work with case classes when writing, reading or creating tables
(Script) Generates SQL query that selects all fields (recursively for nested fields) from the provided BigQuery schema file.