Search *

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

spark stream connector scala ingestion eventhubs continuous microsoft structured-streaming apache-spark streaming bigdata spark-streaming apache event-hubs databricks kafka real-time azure

131 117 31

Custom state store providers for Apache Spark

spark state stateful structured-streaming apache-spark state-store spark-structured-streaming spark-streaming apache

53 17 3

Spark Structured Streaming State Tools

22 4 2

Rocksdb state storage implementation for Structured Streaming.

rocksdb structured-streaming real-time-processing streaming state-management performance spark scalability qubole

10 3 3

Kafka offset committer for structured streaming query

9 3 2

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).

spark scala spark-streaming streaming s3 sqs structured-streaming

1 0 2

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

spark micro-batches sla scala sparklens spark-streaming streaming-pipeline structured-streaming streaming cluster-management

0 0 2