DIS Spark Streaming is a sdk provided by the Data Access Service (DIS). It can be used to create a DStream to connect to SparkStreaming.
Quick Links:
- issue
- DIS Homepage, or Chinese language site 数据接入服务
- JDK 1.8+
- Scala-sdk-2.11
The recommended way to use the DIS SDK for SparkStreaming in your project is to consume it from Maven.
<dependency>
<groupId>com.huaweicloud.dis</groupId>
<artifactId>huaweicloud-dis-spark-streaming_2.11</artifactId>
<version>1.2.2</version>
<scope>compile</scope>
</dependency>
Once you check out the code from GitHub, you can build it using Maven:
mvn clean install