A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).
Scala versions:
2.11
spark-sql-streaming-sqs 0.5.1
Group ID:
com.qubole
Artifact ID:
spark-sql-streaming-sqs_2.11
Version:
0.5.1
Release Date:
Apr 14, 2020
Licenses:
Files:
libraryDependencies += "com.qubole" %% "spark-sql-streaming-sqs" % "0.5.1"
ivy"com.qubole::spark-sql-streaming-sqs:0.5.1"
//> using dep "com.qubole::spark-sql-streaming-sqs:0.5.1"
import $ivy.`com.qubole::spark-sql-streaming-sqs:0.5.1`
<dependency> <groupId>com.qubole</groupId> <artifactId>spark-sql-streaming-sqs_2.11</artifactId> <version>0.5.1</version> </dependency>
compile group: 'com.qubole', name: 'spark-sql-streaming-sqs_2.11', version: '0.5.1'