Spark-tools Logo

CircleCI

Spark-tools is a set of tools dedicated to Spark and aims to make the life of data engineers easier.

The tools

  • Spark-Test, testing tools for Dataframe and Dataset from Spark
  • Parka, data quality on Spark
  • Fenek, a DSL for semi-typed transformation in Scala for Spark
  • Plumbus, light misc things for Spark
  • Spark-ZIO, Spark in ZIO environment