gilt / calatrava-client-library   0.0.8

GitHub

A library for consuming events from Calatrava.

Scala versions: 2.11 2.10

calatrava-client-library

A library that allows consumption of events from a Calatrava stream.

Contents and Example Usage

kinesis.BridgeConfiguration

This class encapsulates configuration needed for the Worker. Some of it regards the Calatrava Bridge that we need to consume events for. The last part, if present, enables KCL metrics reporting into CloudWatch.

The following parameters must be provided:

  • clientAppName: mandatory String parameter to specify the name of this Kinesis client application. Must be unique for this Bridge.

  • streamName: mandatory String parameter, specifies the name of the Kinesis stream associated with the Bridge.

  • bucketName: mandatory String parameter, specifies the name of the S3 bucket associated with the Bridge.

  • iamRoleArnOpt: optional String parameter, specifies an IAM role that this application must assume prior to making calls to Kinesis, or S3. If not specified, the application will use the default credentials provider chain. If specified, this role should have permissions to read from the Bridge (S3, Kinesis), and, if necessary, permissions to create metrics in CloudWatch (see below).

  • metricsConfigOpt: optional MetricsConfiguration parameter, specifies CloudWatch metrics configuration parameters. If not provided, the Kinesis Client library will not send metrics to CloudWatch.

kinesis.CalatravaEventProcessor

An implementation of this interface must be constructed and passed to the Worker factory, so that events are being sent here for processing. Has only one method, processEvent, which takes a parameter of type ChangeEvent, as defined in the Calatrava API. It must return true if the event was successfully processed, false otherwise.

Worker Factory

A singleton instance of this class should be created, and then used to produce KCL workers as needed.

Example:

val factory = new BridgeWorkerFactory(eventProcessor, bridgeConfiguration)
val worker = factory.instance()
val workerThread = new Thread(worker)

def start(): Unit = {
  workerThread.start()
}

def shutdown(): Unit = {
  worker.shutdown()
  workerThread.join(WORKER_THREAD_TIMEOUT_MILLIS)
}

The BridgeWorkerFactory can be instantiated with Guice, and have its configuration and processor injected automatically.

License

Copyright 2015 Gilt Groupe, Inc.

Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0