banzaicloud / spark-metrics   2.4-1.0.6

Apache License 2.0 GitHub

Spark metrics related custom classes and sinks (e.g. Prometheus)

Scala versions: 2.12 2.11

Apache Spark metrics extensions

This is a repository for ApacheSpark metrics related custom classes (e.g. sources, sinks). We were trying to extend the Spark Metrics subsystem with a Prometheus sink but the PR was not merged upstream. In order to support others to use Prometheus we have externalized the sink and made available through this repository, thus there is no need to build an Apache Spark fork.

For further information how we use this extension and the Prometheus sink at Banzai Cloud please read these posts: