guardian / emr-cluster-manager

AWS EMR utility library

GitHub

emr cluster manager

Library to help with definition and instantiation of AWS EMR clusters.

features

  • typed representations of cluster configuration settings ("classification" in AWS terminology)
  • spot pricing utility (look up spot price of instance, with ability to add percentage adjustment)
  • create/lookup running cluster
  • submit steps

planned featuers

  • typed bootstrap scripts

running test requests

There is a simple test app, TestRequest that takes care of instantiating an EMR client with "ophan" credentials and creating a ClusterManager instance. You can adjust this and run it with sbt test:run.

releasing

Follow the guide to publishing on Maven if you haven't already.

Then: sbt release

Use sbt publishLocal (and add a dependency on x.y.z-SNAPSHOT) when working locally.