huaweicloud / spark-streaming-dis-plugin   1.2.3

Apache License 2.0 GitHub

DIS SDK for SparkStreaming

Scala versions: 2.11

DIS SDK for SparkStreaming

DIS Spark Streaming is a sdk provided by the Data Access Service (DIS). It can be used to create a DStream to connect to SparkStreaming.

Quick Links:

Getting Started

Requirements

  • JDK 1.8+
  • Scala-sdk-2.11

Install the JDK

The recommended way to use the DIS SDK for SparkStreaming in your project is to consume it from Maven.

Specify the SDK Maven dependency

<dependency>
    <groupId>com.huaweicloud.dis</groupId>
    <artifactId>huaweicloud-dis-spark-streaming_2.11</artifactId>
    <version>1.2.2</version>
    <scope>compile</scope>
</dependency>

Building From Source

Once you check out the code from GitHub, you can build it using Maven:

mvn clean install

License

Apache License 2.0