Search *

intel-analytics/analytics-zoo

Distributed Tensorflow, Keras, PyTorch and BigDL on Apache Spark

Scala (JVM):

Sbt: 2.1 2.2 2.3 2.4

deep-neural-network pytorch distributed-deep-learning analytics-zoo python keras-tensorflow scala apache-spark bigdl

1207 316 58

datasystemslab/geospark

A Cluster Computing System for Processing Large-Scale Spatial Data

Scala (JVM):

geospatial spatial-sql spatial-analysis spatial-index spatial-queries apache-spark cluster-computing spatial-join

619 315 34

microsoft/mobius

C# and F# language binding and extensions to Apache Spark

Scala (JVM): 2.10 2.11

dataset dstream spark rdd spark-streaming mapreduce fsharp apache-spark kafka-streaming dataframe csharp eventhubs mobius bigdata near-real-time streaming

737 173 32

hydrospheredata/mist

Serverless proxy for Spark cluster

Scala (JVM): 2.10 2.11 2.12

Sbt: 2.11

apache-spark api big-data serverless

247 59 24

lucacanali/sparkmeasure

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark workload metrics data.

Scala (JVM): 2.11 2.12

performance-troubleshooting spark spark-troubleshooting performance-metrics apache-spark

285 62 7

azure/azure-cosmosdb-spark

Apache Spark Connector for Azure Cosmos DB

Scala (JVM):

Sbt: 2.11

spark databricks-notebooks cosmos-db connector jupyter-notebook changefeed azure-cosmos-db databricks apache-spark azure-databricks lambda-architecture pyspark

139 93 19

azure/azure-event-hubs-spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Scala (JVM): 2.11

structured-streaming apache stream spark connector spark-streaming real-time databricks scala apache-spark event-hubs microsoft eventhubs azure continuous streaming

115 88 26

seznam/euphoria

Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.

Scala (JVM):

java-api hdfs big-data streaming-data kafka unified-bigdata-processing apache-spark apache-flink hadoop batch-processing

59 9 10

kakao/cuesheet

A framework for writing Spark 2.x applications in a pretty way

Scala (JVM): 2.10 2.11

spark scala apache-spark mango magic yarn

78 21 2

uosdmlab/spark-nkp

Natural Korean Processor for Apache Spark

Scala (JVM): 2.11

nlp spark-mllib spark text-mining apache-spark natural-language-processing korean-nlp

41 13 2

bizreach/aws-kinesis-scala

Scala client for Amazon Kinesis. Also provides write to Kinesis capability for Apache Spark or Spark Streaming.

Scala (JVM): 2.11 2.12 2.13

aws aws-kinesis spark scala apache-spark kinesis

26 11 4

flipkart-incubator/spark-transformers

Spark-Transformers: Library for exporting Apache Spark MLLIB models in to use them in any Java application with no other dependencies.

Scala (JVM): 2.10 2.11

machine-learning-algorithms spark mllib machine-learning-library java machine-learning scala apache-spark export transformers data-pipelines

25 20 8

itspawanbhardwaj/spark-fuzzy-matching

Fuzzy matching function in spark (https://spark-packages.org/package/itspawanbhardwaj/spark-fuzzy-matching)

Scala (JVM): 2.11

fuzzy-matching apache-spark scala

16 5 1

liquidsvm/liquidsvm

Support vector machines (SVMs) and related kernel-based learning algorithms are a well-known class of machine learning algorithms, for non-parametric classification and regression. liquidSVM is an implementation of SVMs whose key features are: fully integrated hyper-parameter selection, extreme speed on both small and large data sets, full flexibility for experts, and inclusion of a variety of different learning scenarios: multi-class classification, ROC, and Neyman-Pearson learning, and least-squares, quantile, and expectile regression.

Scala (JVM): 2.11

ml regression r octave python r-package svm machine-learning apache-spark matlab quantile-regression expectile-regression rstats classification c-plus-plus

14 2 3

astrolabsoftware/spark-fits

FITS data source for Spark SQL and DataFrames

Scala (JVM): 2.10 2.11 2.12

hdfs fitsio spark-sql scala apache-spark fits pyspark

11 4 3

tupol/spark-utils

Basic framework utilities to quickly start writing production ready Apache Spark applications

Scala (JVM): 2.11 2.12

spark framework spark-streaming data-source convenience spark-applications data-sink scala apache-spark

9 0 1

astrolabsoftware/spark3d

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

Scala (JVM): 2.11

spatial-data scientific-computing scala apache-spark pyspark 3d

9 3 3

emcecs/spark-ecs-connector

ECS connector for Apache Spark

Scala (JVM): 2.11

apache-spark ecs

7 1 3

tupol/spark-tools

Executable Apache Spark Tools: Format Converter & SQL Processor

Scala (JVM): 2.11

tools spark scala apache-spark converts sql format-converter

6 0 1

coxautomotivedatasolutions/vegalite4s

Vega-Lite4s is a small library over the comprehensive Vega-Lite Javascript visualisation library, allowing you to create beautiful Vega-Lite visualisations in Scala

Scala (JVM): 2.11 2.12

vega spark vega-lite scala apache-spark visualization

4 0 1

Sorting

Filters

intel-analytics/analytics-zoo

datasystemslab/geospark

microsoft/mobius

hydrospheredata/mist

lucacanali/sparkmeasure

azure/azure-cosmosdb-spark

azure/azure-event-hubs-spark

seznam/euphoria

kakao/cuesheet

uosdmlab/spark-nkp

bizreach/aws-kinesis-scala

flipkart-incubator/spark-transformers

itspawanbhardwaj/spark-fuzzy-matching

liquidsvm/liquidsvm

astrolabsoftware/spark-fits

tupol/spark-utils

astrolabsoftware/spark3d

emcecs/spark-ecs-connector

tupol/spark-tools

coxautomotivedatasolutions/vegalite4s