isarn/isarn-sketches-spark   0.6.0-sp3.2

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

cognitedata/cdp-spark-datasource   3.21.1161

Spark data source for Cognite Data Fusion

arcizon/spark-filetransfer   0.3.0

API for reading and writing data via various file transfer protocols from Apache Spark.

apache/incubator-wayang   0.7.1

Apache Wayang(incubating) is the first cross-platform data processing system.

kotlin/kotlin-spark-api   1.2.4

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

woltapp/spark-osm-datasource   0.3.0

Native Spark OSM PBF data source

s22s/pre-lt-raster-frames   0.6.1

Spark DataFrames for earth observation data

romans-weapon/spear-framework   3.1.1-3.0

Rapid ETL/ELT-connectors/pipeline development leveraged on top of Apache Spark

qubole/streaminglens   0.5.3

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines

florentf9/sparkml-som   0.2

:sparkles: Spark ML implementation of SOM algorithm (Kohonen self-organizing map)

hammerlab/spark-util   3.1.0

low-level helpers for Apache Spark libraries and tests

piotr-kalanski/data-quality-monitoring   0.3.8

Data Quality Monitoring Tool

getsentry/sentry-spark   0.0.1-alpha04

Apache Spark Sentry Integration

qubole/s3-sqs-connector   0.5.1

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).

derrickoswald/cimspark   2.12-3.0.1-5.1.1

Spark access to Common Information Model (CIM) files

jtnystrom/discount   3.0.1

Very large scale k-mer counting and analysis on Apache Spark.

fqaiser94/mse   0.2.4

Make Structs Easy (MSE)

absaoss/spark-hofs   0.5.0

Scala API for Apache Spark SQL high-order functions

zuinnote/spark-hadoopcryptoledger-ds   1.3.2

A Spark datasource for the HadoopCryptoLedger library

hunters-ai/spark-adaptive-file-connector   1.0.0

Adaptive File Source Connector for Spark, optimised for reading from object stores