Search *

15 results

microsoft/synapseml

Simple and Distributed Machine Learning

Scala versions: 2.12 2.11

deep-learning databricks apache-spark onnx lightgbm azure cognitive-services opencv big-data data-science spark ai microsoft machine-learning ml pyspark synapse scala http model-deployment

4875 100
johnsnowlabs/spark-nlp

State of the Art Natural Language Processing

Scala versions: 2.12 2.11

nlp question-answering llm text-classification sentiment-analysis spell-checker part-of-speech-tagger pyspark entity-extraction lemmatizer language-detection named-entity-recognition machine-translation tensorflow language-model transformers spark albert bert natural-language-processing

3516 85
h2oai/sparkling-water

Sparkling Water provides H2O functionality inside Spark cluster

Scala versions: 2.12 2.11 2.10

rsparkling integration big-data pysparkling pyspark spark scala h2o machine-learning

956 45
azure/azure-cosmosdb-spark

Apache Spark Connector for Azure Cosmos DB

Scala versions: 2.11 2.10

databricks apache-spark lambda-architecture cosmos-db databricks-notebooks azure-databricks connector azure-cosmos-db jupyter-notebook pyspark spark changefeed

195 24
g-research/spark-extension

A library that provides useful extensions to Apache Spark and PySpark.

Scala versions: 2.13 2.12 2.11

gr-oss java pyspark spark scala python

137 95 4
minio/spark-select

A library for Spark DataFrame using MinIO Select API

Scala versions: 2.11

bigdata amazon-s3 parquet-files select pyspark spark minio sbt spark-sql

97 2
jelmerk/hnswlib

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

Scala versions: 2.13 2.12 2.11

k-nearest-neighbors java pyspark spark scala knn-search algorithm

225 0 4
databrickslabs/automl-toolkit

Toolkit for Apache Spark ML for Feature clean-up, feature Importance calculation suite, Information Gain selection, Distributed SMOTE, Model selection and training, Hyper parameter optimization and selection, Model interprability.

Scala versions: 2.11

apache-spark feature-engineering spark scala ml pyspark machinelearning

186 7
g-research/spark-dgraph-connector

A connector for Apache Spark and PySpark to Dgraph databases.

Scala versions: 2.12

dgraph gr-oss pyspark spark

40 4
isarn/isarn-sketches-spark

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Scala versions: 2.12 2.11 2.10

dataframes sketching-algorithm apache-spark aggregator data-sketches dataframe variable-importance datasets t-digest data-sketching spark scala spark-ml pyspark dataset udaf python feature-importance

29 2
astrolabsoftware/spark3d

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

Scala versions: 2.11

apache-spark scientific-computing pyspark scala spatial-data 3d

28 4
astrolabsoftware/spark-fits

FITS data source for Spark SQL and DataFrames

Scala versions: 2.12 2.11 2.10

fits apache-spark pyspark scala hdfs fitsio spark-sql

19 5
fqaiser94/mse

Make Structs Easy (MSE)

Scala versions: 2.12 2.11

pyspark spark scala python struct nested

18 1
sb-ai-lab/replay

A Comprehensive Framework for Building End-to-End Recommendation Systems with State-of-the-Art Models

Scala versions: 2.12

deep-learning algorithms pytorch matrix-factorization pyspark collaborative-filtering recommender-system recommendation-algorithms evaluation distributed-computing machine-learning

89 19
ozancicek/artan

Online latent state estimation with Spark

Scala versions: 2.12 2.11

kalman-filter streaming spark-structured-streaming sparkml pyspark spark python scala finite-mixture

5 1