Search *

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

real-time event-hubs structured-streaming spark-streaming apache stream scala spark microsoft eventhubs streaming ingestion apache-spark databricks azure connector bigdata continuous kafka

131 117 31

Custom state store providers for Apache Spark

state stateful apache-spark structured-streaming spark-streaming spark-structured-streaming apache spark state-store

53 17 3

Spark Structured Streaming State Tools

22 4 2

Rocksdb state storage implementation for Structured Streaming.

real-time-processing structured-streaming rocksdb spark scalability state-management performance streaming qubole

10 3 3

Kafka offset committer for structured streaming query

9 3 2

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).

structured-streaming s3 spark-streaming scala spark streaming sqs

1 0 2

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

cluster-management streaming-pipeline structured-streaming sparklens spark-streaming scala spark sla streaming micro-batches

0 0 2