Search *

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

streaming continuous databricks azure real-time apache-spark eventhubs stream scala microsoft event-hubs structured-streaming connector spark-streaming apache spark

128 113 29

Custom state store providers for Apache Spark

spark-streaming state apache-spark structured-streaming state-store stateful spark-structured-streaming apache spark

53 17 3

Spark Structured Streaming State Tools

22 4 2

Kafka offset committer for structured streaming query

9 3 2

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).

streaming spark-streaming sqs spark scala s3 structured-streaming

1 0 2

Rocksdb state storage implementation for Structured Streaming.

streaming scalability qubole performance spark state-management real-time-processing rocksdb structured-streaming

1 0 2

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

streaming micro-batches spark-streaming cluster-management spark sla streaming-pipeline scala sparklens structured-streaming

0 0 2