starlake-ai / starlake 1.4.0

Apache License 2.0 Website GitHub

Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.

Scala versions: 2.13

starlake-core 1.4.0

Group ID:

ai.starlake

Artifact ID:

starlake-core_2.13

Version:

1.4.0

Release Date:

Apr 2, 2025

Licenses:

Apache-2.0

Files:

View all

Full Scala Version:

2.13.16

Developers:

libraryDependencies += "ai.starlake" %% "starlake-core" % "1.4.0"

Mill build tool

ivy"ai.starlake::starlake-core:1.4.0"

Scala CLI

//> using dep "ai.starlake::starlake-core:1.4.0"

Ammonite REPL

import $ivy.`ai.starlake::starlake-core:1.4.0`

<dependency>
  <groupId>ai.starlake</groupId>
  <artifactId>starlake-core_2.13</artifactId>
  <version>1.4.0</version>
</dependency>

compile group: 'ai.starlake', name: 'starlake-core_2.13', version: '1.4.0'

Documentation

Scaladoc

Try online with Scastie

74 Dependencies

ai.starlake.jsqltranspiler:jsqltranspiler

0.7-SNAPSHOT
com.databricks::spark-xml

0.18.0
com.github.ben-manes.caffeine:caffeine

3.2.0
com.github.jsqlparser:jsqlparser

5.2-SNAPSHOT
com.github.pathikrit::better-files

3.9.2
com.github.pureconfig::pureconfig

0.14.0
com.github.scopt::scopt

4.1.0
com.google.apis:google-api-services-sheets

4-rev20250211-2.0.0
com.google.cloud.bigdataoss:bigquery-connector

hadoop3-1.2.0
com.google.cloud.bigdataoss:gcs-connector

hadoop3-2.2.26
com.google.cloud:google-cloud-bigquery

2.49.0
com.google.cloud:google-cloud-datacatalog

1.62.0
com.google.cloud:google-cloud-logging

3.21.4
com.hubspot.jinjava:jinjava

2.7.4
com.manticore-projects.jsqlformatter:jsqlformatter

5.1-SNAPSHOT
com.networknt:json-schema-validator

1.4.0
com.typesafe.scala-logging::scala-logging

3.9.5
com.typesafe:config

1.4.2
io.swagger.parser.v3:swagger-parser

2.1.25
net.java.dev.jna:jna

5.12.1
org.apache.kafka:kafka-clients

7.7.2-ce
org.apache.poi:poi-ooxml

4.1.2
org.apache.spark:spark-avro_2.13

3.5.5
org.apache.spark:spark-sql-kafka-0-10_2.13

3.5.5
org.duckdb:duckdb_jdbc

1.2.1
org.scala-lang.modules::scala-collection-compat

2.12.0
org.scala-lang.modules::scala-parallel-collections

1.0.4
org.scala-lang:scala-library

2.13.16
org.scala-lang:scala-reflect

2.13.16
org.scalatra.scalate::scalate-core

1.9.8
ai.starlake::starlake-streaming provided

1.3.4
com.amazon.redshift:redshift-jdbc42 provided

2.1.0.32
com.amazonaws:aws-java-sdk-bundle provided

1.12.782
com.fasterxml.jackson.core:jackson-annotations provided

2.15.2
com.fasterxml.jackson.core:jackson-core provided

2.15.2
com.fasterxml.jackson.core:jackson-databind provided

2.15.2
com.fasterxml.jackson.dataformat:jackson-dataformat-yaml provided

2.15.2
com.fasterxml.jackson.datatype:jackson-datatype-jsr310 provided

2.15.2
com.fasterxml.jackson.module::jackson-module-scala provided

2.15.2
com.google.cloud.spark:spark-bigquery-with-dependencies_2.13 provided

0.42.1
com.microsoft.azure:azure-storage provided

8.6.6
io.confluent:kafka-avro-serializer provided

7.7.2
io.confluent:kafka-schema-registry-client provided

7.7.2
io.delta::delta-spark provided

3.3.0
net.snowflake::spark-snowflake provided

3.1.1
net.snowflake:snowflake-jdbc provided

3.23.0
org.apache.hadoop:hadoop-aws provided

3.3.4
org.apache.hadoop:hadoop-azure provided

3.4.0
org.apache.hadoop:hadoop-client provided

3.3.6
org.apache.hadoop:hadoop-common provided

3.3.6
org.apache.hadoop:hadoop-hdfs provided

3.3.6
org.apache.hadoop:hadoop-mapreduce-client-app provided

3.3.6
org.apache.hadoop:hadoop-yarn-client provided

3.3.6
org.apache.spark:spark-core_2.13 provided

3.5.5
org.apache.spark:spark-hive_2.13 provided

3.5.5
org.apache.spark:spark-mllib_2.13 provided

3.5.5
org.apache.spark:spark-sql_2.13 provided

3.5.5
org.elasticsearch::elasticsearch-spark-30 provided

8.16.3
org.postgresql:postgresql provided

42.7.5
ai.starlake:spark-redshift_2.13 test

6.3.0-spark_3.5-SNAPSHOT
com.dimafeng::testcontainers-scala-elasticsearch test

0.41.8
com.dimafeng::testcontainers-scala-kafka test

0.41.8
com.dimafeng::testcontainers-scala-mariadb test

0.41.8
com.dimafeng::testcontainers-scala-postgresql test

0.41.8
com.dimafeng::testcontainers-scala-scalatest test

0.41.8
com.google.cloud.sql:postgres-socket-factory test

1.23.1
com.h2database:h2 test

2.3.232
com.mysql:mysql-connector-j test

9.2.0
org.apache.derby:derby test

10.14.2.0
org.apache.derby:derbyclient test

10.14.2.0
org.apache.derby:derbynet test

10.14.2.0
org.mariadb.jdbc:mariadb-java-client test

3.5.1
org.scalatest::scalatest test

3.2.19
org.scalatestplus::scalacheck-1-17 test

3.2.18.0

starlake-ai / starlake 1.4.0

starlake-core 1.4.0

Documentation

Try online with Scastie

74 Dependencies

No Dependent