Spark-tools is a set of tools dedicated to Spark and aims to make the life of data engineers easier.

The tools

  • Centrifuge, a couple of techniques for data quality on Spark
  • Fenek, a DSL for semi-typed transformation in Scala for Spark
  • Plumbus, light misc things for Spark
  • Spark-ZIO, Spark in ZIO environment