univalence / spark-tools   0.3

Apache License 2.0 Website GitHub
Scala versions: 2.12 2.11

Spark-tools Logo

CircleCI

Spark-tools is a set of tools dedicated to Spark and aims to make the life of data engineers easier.

The tools

  • Spark-Test, testing tools for Dataframe and Dataset from Spark
  • Parka, data quality on Spark
  • Fenek, a DSL for semi-typed transformation in Scala for Spark
  • Plumbus, light misc things for Spark
  • Spark-ZIO, Spark in ZIO environment

Statistics

4 Dependencies

No Dependent