starlake.ai ORG

Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.

Skills for Starlake data pipeline CLI. Covers load, transform, extract, autoload, dag-generate, configuration patterns, connection types, write strategies, data quality, and best practices for DuckDB, BigQuery, Snowflake, Airflow & Dagster. 🚧 Work in progress.

Production-grade Arrow FlightSQL gateway in front of DuckDB Quack + DuckLake. Multi-tenant pools, pluggable auth (DB/JWT/OIDC), table-level ACLs, role-aware routing, and a live admin console

Scala gateway that adds multi-user, multi-tenant security and load balancing to DuckDB's Quack extension. Exposes Arrow Flight SQL interface for standard database clients (DBeaver, Spark, JDBC/ODBC). Includes authentication, per-table access control, node pooling, and a web admin console.

Rewrite BigQuery, Redshift, Snowflake and Databricks queries into DuckDB compatible SQL (with deep transformation of functions, data types and format characters) using Java.

No description.

starlake orchestration

No description.

No description.

No description.

various benchmarks

A collection of JSON schema files including full API

JSqlParser parses an SQL statement and translate it into a hierarchy of Java classes. The generated hierarchy can be navigated using the Visitor Pattern

No description.

No description.

No description.

SQLAlchemy driver for DuckDB

Follow along with our tutorials to get you up and running with Snowflake.

DuckDB JDBC Driver

No description.

No description.

Apache Spark - A unified analytics engine for large-scale data processing

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.