lakeFS by Treeverse ORG

lakeFS - Data version control for your data lake | Git for data

lakefs-samples repository

Helm charts

🦉 Data Versioning and ML Experiments

DVC adds Git-style version control for large data files, ML models, and experiments to machine learning projects, syncing big files to cloud storage while keeping lightweight pointers in your Git repo.

📖 DVC documentation website

Machine learning experiment tracking and data versioning with DVC extension for VS Code

Get started DVC project (NLP, random forest)

📈 Log and track ML metrics, parameters, models with Git and/or DVC

Dataset registry DVC project

Get started DVC project

DVC GitHub action

lakeview is a visibility tool for S3 based data lakes

lakeFS airflow operator

SCM wrapper and fsspec filesystem for Git for use in DVC.

supporting code for lakeFS blogs

Benchmarks for DVC

Boto S3 Router provides a Boto3-like client that routes requests between S3 clients according to the bucket and the key in the request.

DVC's data management subsystem

dvc objects - contains filesystem and object-db level abstractions to use in dvc and dvc-data

Schema for dvc.yaml

a simple lakeFS webhook for pre-commit and pre-merge validation of data objects

AWS S3 plugin for dvc

Client to interact with DVC Studio

Celery task queue used in DVC

Data sets and ML models versioning example from DVC get started

Maintain deb and rpm repositories on s3

SQL-based prefix tree implementation inspired by pygtrie and python-diskcache

Library for rendering DVC plots

Data + AI Summit 2022 lakeFS challenge

An example project, showcasing a DVC pipeline using SageMaker SDK for data preparation and model training

Track and enforce quota on S3

Google Storage plugin for dvc

A curated list of data engineering tools for software developers

Alibaba OSS plugin for dvc

RouterFileSystem is a Hadoop FileSystem implementation that transforms URIs at runtime according to provided configurations. It then routes file system operations to another Hadoop file system that executes it against the underlying object store.

Google Drive plugin for DVC

A repository containing links to the best DVC/DataChain related content

Axolotl, lakeFS Developers Mascot

Webdav plugin for dvc

Presto environment part of blog post

Azure plugin for dvc

No description.

No description.

Private repository for building and signing dvc for windows

dvc snap package

A Cookiecutter template for dvc plugins

Homebrew recipe tap repository

SSH/SFTP plugin for dvc

No description.

lakeFS documentation - docs.lakefs.io

Chocolatey package for dvc

Native Delta Lake Implementation in Go

HDFS/WebHDFS plugin for dvc

HTTP plugin for dvc

WebHDFS plugin for dvc

LSTM sequence-2-sequence example project

Spark SQL extensions for lakeFS

Repository for building and signing dvc for mac

lakeFS Iceberg REST Catalog -> AWS Glue Catalog Federation

Fast directory traversal for Golang

A plugin for MKDocs for rendering swagger & openapi schemas using SwaggerUI.

No description.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

A custom Iceberg catalog implementation for lakeFS

A lakeFS client for Apache Spark

Code review challenge - YanShlain

A modern JavaScript utility library delivering modularity, performance, & extras.

golang NFSv3 server

FUSE bindings for Go

FUSE bindings for Go

FUSE bindings for Go

Apache Iceberg - Go

Bitnami container images

Katacoda interactive Scenarios - https://www.katacoda.com/treeverse

The MinIO Admin Go Client SDK provides APIs to manage MinIO services

[MinIO] Unix like utilities for object store

MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.

No description.

OpenAPI Diff and Breaking Changes

OpenAPI Generator allows generation of API client libraries (SDK generation), server stubs, documentation and configuration automatically given an OpenAPI Spec (v2, v3)

lakeFS for Databricks documentation - docs-databricks.lakefs.io

RocksDB/LevelDB inspired key-value database in Go

sync users and groups from Entra ID to lakeFS Cloud

⚡ Building applications with LLMs through composability ⚡

Access other storage backends via the S3 API

Website data for no-color.org

No description.

Golang LRU cache

A set of utilities to work interactively with a lakeFS playground from notebook environments

OpenShift Helm charts Repository

lakeFS airflow operator

Fork of Thrift Docker Image repository

Create a Hive Metastore clone pointing to a requested branch.

Docker image that wraps Yelp/swagger_spec_validator

This repository contains the source code and deployment scripts for Kubernetes-based applications listed in the DigitalOcean Marketplace.

For the distributed charts search at hub.helm.sh