Search *

27 results

bigdatagenomics/adam

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

Scala versions: 2.12 2.11 2.10

parquet genomics big-data java avro spark scala python r bioinformatics

958 67
sksamuel/avro4s

Avro schema generation and serialization / deserialization for Scala

Scala versions: 3.x 2.13 2.12 2.11 2.10

scala-macros schema-generation coproduct serialization avro avro-schema scala

702 79
spotify/ratatool

A tool for data sampling, data generation, and data diffing

Scala versions: 2.13 2.12 2.11 2.10

parquet protobuf bigquery avro scalacheck scala

332 33
absaoss/abris

Avro SerDe for Apache Spark structured APIs.

Scala versions: 2.12 2.11

schema-registry avro kafka spark avro-schema

220 12 19
julianpeeters/avrohugger

Generate Scala case class definitions from Avro schemas

Scala versions: 2.13 2.12 2.11 2.10

avro scala

192 39
theiterators/kebs

Scala library to eliminate boilerplate

Scala versions: 3.x 2.13 2.12 2.11

Scala.js versions: 1.x

slick play akka restful akka-http avro scala play-framework hack spray boilerplate

152 17
spotify/magnolify

A collection of Magnolia add-on modules

Scala versions: 2.13 2.12 2.11

magnolia tensorflow bigquery avro scalacheck scala datastore google-cloud cats

151 25
julianpeeters/sbt-avrohugger

sbt plugin for generating Scala sources for Apache Avro schemas and protocols.

Scala versions: 2.12 2.10

sbt plugins: 1.0 0.13

avro sbt-plugin scala

128 14
ovotech/kafka-serialization

Lego bricks to build Apache Kafka serializers and deserializers

Scala versions: 2.12 2.11

apache-kafka json serialization json4s avro avro4s circe spray-json

121 6 16
indix/schemer

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

Scala versions: 2.11

schema-registry json parquet tsv avro spark graphql-api schema-inference

110 4
fd4s/vulcan

Functional Avro for Scala

Scala versions: 3.x 2.13 2.12 2.11

avro scala

92 15
nevillelyh/shapeless-datatype

Shapeless utilities for common data types

Scala versions: 2.13 2.12 2.11 2.10

tensorflow bigquery avro scala datastore google-cloud shapeless

67 125 5
azhur/kafka-serde-scala

Implicitly converts typeclass encoders to kafka Serializer, Deserializer, Serde.

Scala versions: 3.x 2.13 2.12 2.11

deserialize json4s avro4s jackson kafka-serializers kafka-streams json serde protobuf-kafka zio-json jsoniter-scala scalapb serialization avro kafka upickle scala circe avro-kafka kafka-serde-scala

54 5
laserdisc-io/tamer

Standalone alternatives to Kafka Connect Connectors

Scala versions: 2.13 2.12

schema-registry s3 fp zio scala zio-streams fs2 functional-programming jdbc doobie avro kafka

41 8
agile-lab-dev/darwin

Avro Schema Evolution made easy

Scala versions: 2.13 2.12 2.11 2.10

ignite schema-evolution avro hadoop avro4s scala hbase spark avro-schema

31 8
lensesio/avro-sql

Use SQL to transform your avro schema/records

Scala versions: 2.11

avro avro-schema sql

28 2
garyaiki/dendrites

Scala library for Reactive streaming Microservices, CQRS, Event Sourcing, Event Logging, & message-driven apps.

Scala versions: 2.12 2.11

cqrs json event-sourcing cassandra akka-http akka-actors scala reactive-programming microservices avro kafka algebird akka-streams

23 1
nevillelyh/parquet-extra

A collection of Apache Parquet add-on modules

Scala versions: 2.13 2.12 2.11 2.10

magnolia scala-macros avro scala tensorflow parquet

30 4
amient/affinity

Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka

Scala versions: 2.12 2.11

distributed-systems restapi stream-processing high-availability akka-http scalability avro kafka

26 3
spotify/scio-contrib

Community-supported add-ons for Scio

Scala versions: 2.12 2.11

scio data bigquery avro dataflow beam scala google-cloud

7 5