Search *

deeplearning4j/datavec

ETL Library for Machine Learning - data pipelines, data munging and wrangling

formatter data-munging writables pipeline transformations hadoop-ecosystem schema spark etl datapipeline machine-learning svmlight

219 162 37

streamnative/pulsar-flink

Elastic data processing with Apache Pulsar and Apache Flink

Scala (JVM): 2.11 2.12

data-processing apache-pulsar catalog sql flink-connector stream-processing apache-flink flink schema schema-registry batch-processing pulsar flink-stream-processing

147 66 22

carueda/tscfg

Boilerplate-free, type safe access to configuration properties in Java and Scala

Scala (JVM): 2.11 2.12 2.13

configuration typesafe java immutable scala schema pojo typesafe-config

83 13 6

samelamin/spark-bigquery

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

Scala (JVM): 2.11

bigquery data-frame schema spark

63 29 5

durban/seals

Tools for schema evolution and language-integrated schemata

Scala (JVM): 2.10 2.11 2.12 2.13

Sbt: 0.13 1.0

serialization generic-programming generic-derivation scala schema-evolution schema

50 7 3

absaoss/spark-hats

Nested array transformation helper extensions for Apache Spark

Scala (JVM): 2.11 2.12

nested-structures scala schema spark arrays

10 0 3

vectos/formulation

formulation is a EDSL (embedded domain specific language) for describing Avro data types.

Scala (JVM): 2.11 2.12

edsl avro scala schema

7 1 2

carueda/cfg

Type safety all the way from configuration spec to configuration access in Scala

Scala (JVM): 2.11 2.12

typesafe-configuration configuration typesafe scala scalameta schema typesafe-config

3 1 1

Sorting

Filters

deeplearning4j/datavec

streamnative/pulsar-flink

carueda/tscfg

samelamin/spark-bigquery

durban/seals

absaoss/spark-hats

vectos/formulation

carueda/cfg