cerndb / sparkplugins   0.3

Apache License 2.0 GitHub

Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are initialized. This also allows extending the Spark metrics systems with user-provided monitoring probes.

Scala versions: 2.13 2.12

spark-plugins 0.2


Group ID:
ch.cern.sparkmeasure
Artifact ID:
spark-plugins_2.13
Version:
0.2
Release Date:
Aug 26, 2022
Licenses:
Files:

libraryDependencies += "ch.cern.sparkmeasure" %% "spark-plugins" % "0.2"

Mill build tool

ivy"ch.cern.sparkmeasure::spark-plugins:0.2"

Scala CLI

//> using dep "ch.cern.sparkmeasure::spark-plugins:0.2"

Ammonite REPL

import $ivy.`ch.cern.sparkmeasure::spark-plugins:0.2`

<dependency>
  <groupId>ch.cern.sparkmeasure</groupId>
  <artifactId>spark-plugins_2.13</artifactId>
  <version>0.2</version>
</dependency>

compile group: 'ch.cern.sparkmeasure', name: 'spark-plugins_2.13', version: '0.2'