Search *

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

eventhubs spark streaming continuous databricks stream apache-spark scala azure microsoft structured-streaming event-hubs apache real-time spark-streaming connector

128 113 29

Custom state store providers for Apache Spark

state-store spark stateful apache-spark spark-structured-streaming structured-streaming apache state spark-streaming

53 17 3

Spark Structured Streaming State Tools

22 4 2

Kafka offset committer for structured streaming query

9 3 2

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).

spark streaming scala structured-streaming sqs spark-streaming s3

1 0 2

Rocksdb state storage implementation for Structured Streaming.

real-time-processing spark streaming performance structured-streaming qubole state-management rocksdb scalability

1 0 2

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

spark streaming streaming-pipeline scala structured-streaming cluster-management sparklens micro-batches spark-streaming sla

0 0 2