Search *

Page 2 of 118 results

jcdecaux/setl

A simple Spark ETL framework that just works 🍺

Scala (JVM): 2.11 2.12

etl-pipeline machine-learning data-engineering framework data-science data-analysis data-transformation scala etl pipeline modularization spark dataset big-data setl

30 10 4
tupol/spark-utils

Basic framework utilities to quickly start writing production ready Apache Spark applications

Scala (JVM): 2.11 2.12

apache-spark framework data-source spark-streaming data-sink spark-applications scala convenience spark

9 0 1
hammerlab/spark-util

low-level helpers for Apache Spark libraries and tests

Scala (JVM): 2.10 2.11 2.12

spark scala kryo hadoop

8 4 1
sparklinedata/spark-druid-olap

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

Scala (JVM): 2.10

business-intelligence sparksql olap-cube query-optimization spark

214 73 6
pierrenodet/spark-bagging

Bagging Estimator for Apache Spark ML

Scala (JVM): 2.11

bagging ensembling java scala spark spark-ml mllib

1 0 1
iaja/scalaldavis

Scala-Spark port of https://github.com/bmabey/pyLDAvis for Apache Spark LDA Topic Modelling Visualisation

Scala (JVM): 2.11

machine-learning scala visulization apache spark lda

5 2 1
samelamin/spark-bigquery

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

Scala (JVM): 2.11

bigquery data-frame schema spark

47 21 5
logimethods/nats-connector-spark-scala

A Scala based Spark Publish/Subscribe NATS Connector

Scala (JVM): 2.10 2.11

nats nats-streaming nats-connector nats-payload nats-messaging scala spark

1 2 1
helgeho/archivespark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

Scala (JVM): 2.11

archivespark webarchive internet-archive spark-framework web-archiving warc spark

103 13 3
indix/schemer

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

Scala (JVM): 2.11

tsv json parquet schema-inference schema-registry avro spark graphql-api

41 2 2
benfradet/spark-kafka-writer

Write your Spark data to Kafka seamlessly

Scala (JVM): 2.10 2.11

kafka spark

97 38 5
azure/mmlspark

Microsoft Machine Learning for Apache Spark

Scala (JVM): 2.11

machine-learning pyspark model-deployment microsoft http cognitive-services cntk ml scala deep-learning lightgbm microsoft-machine-learning spark ai databricks azure

1581 342 38
unicredit/hbase-rdd

Spark RDD to read and write from HBase

Scala (JVM): 2.10 2.11 2.12

scala hbase spark

225 105 6
cdapio/cdap

An open source framework for building data analytic applications.

Scala (JVM): 2.11

mapreduce integration cdap java-8 middleware spark-streaming java unified python platform spark dataset

391 210 100
sansa-stack/sansa-rdf

SANSA RDF Library

Scala (JVM): 2.11

semantic-web flink distributed-computing spark rdf

67 15 13
sansa-stack/sansa-query

SANSA Query Layer

Scala (JVM): 2.11

flink sparql distributed-computing partitioning spark rdf

28 11 12
deeplearning4j/scalnet

A Scala wrapper for Deeplearning4j, inspired by Keras. Scala + DL + Spark + GPUs

Scala (JVM): 2.10 2.11

nd4j deeplearning sbt deeplearning4j scala spark

321 77 11
clustering4ever/clustering4ever

C4E, a Scala or Spark library for local and distributed Clustering.

Scala (JVM): 2.11

artificial-intelligence clustering-evaluation clustering scalability scala bigdata spark ai big-data clustering-algorithm

55 5 3
apache/spark

Apache Spark

Scala (JVM): 2.11 2.12

jdbc sql java scala python spark big-data r

25063 21085 326
googleclouddataproc/spark-bigquery-connector

The connector uses the Spark SQL Data Source API to read data from Google BigQuery.

Scala (JVM): 2.11 2.12

google-bigquery google-cloud bigquery-storage-api bigquery google-cloud-dataproc spark

65 40 14