Spark-tools
Spark-tools is a set of tools dedicated to Spark and aims to make the life of data engineers easier.
The tools
- Centrifuge, a couple of techniques for data quality on Spark
- Fenek, a DSL for semi-typed transformation in Scala for Spark
- Plumbus, light misc things for Spark
- Spark-ZIO, Spark in ZIO environment