Arc is an opinionated framework for defining data pipelines which are predictable, repeatable and manageable.

Arc-Jupyter is an interactive Jupyter Notebooks Extenstion for building Arc data pipelines via Jupyter Notebooks.

Creates a list of formatted dates to easily calculate delta processing periods.

Provides the DebeziumTransform stage

Provides KafkaExtract, KafkaLoad and KafkaCommitExecute stages

Provides the XMLExtract and XMLLoad stages

Provides the DeltaLakeExtract and DeltaLakeLoad stages

Provides the SASExtract stage

Provides the CypherTransform and GraphTransform stages

Provides the CassandraExtract, CassandraExecute, and CassandraLoad stages

Provides ElasticsearchExtract and ElasticsearchLoad stages

Provides the MongoDBExtract and MongoDBLoad stages

Plugin to support extract and load using the spark-bigquery-connector

arc-dataquality-udf-plugin defines a set of data quality/validation user defined functions.

Provides GeoSpark UDFs functionality to Arc.