Databricks Labs ORG

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

Dolly is an open-source instruction-following AI model from Databricks, trained on 15,000 human-written examples and licensed for commercial use, though it is not competitive with larger modern models.

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.

Databricks framework to validate Data Quality of pySpark DataFrames and Tables

API for manipulating time series on top of Apache Spark: lagged time values, rolling statistics (mean, avg, sum, count, etc), AS OF joins, downsampling, and interpolation

An extension to the Apache Spark framework that allows easy and fast processing of very large geospatial datasets.

Automated migrations to Unity Catalog

Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines

THIS PROJECT IS DEPRECATED. Capture deep metrics on one or all assets within a Databricks workspace

Manage your Databricks deployments and CI with code.

Tools to migrate Databricks assets between environments

Toolkit for Apache Spark ML for Feature clean-up, feature Importance calculation suite, Information Gain selection, Distributed SMOTE, Model selection and training, Hyper parameter optimization and selection, Model interprability.

A Business Catalog for Unity Catalog

OntoBricks turns Databricks tables into a materialized knowledge graph with ontology design, R2RML mapping, reasoning, and auto-generated GraphQL APIs.

Accelerates migrations to Databricks by automating key migration activities

Extensible Rules Engine for custom Dataframe / Dataset validation

A Swiss-Army-knife for your Data Intelligence platform administration.

Python Testing for Databricks

Geospatial clustering at massive scale

No description.

R Toolkit for Databricks

No description.

Experimental labs projects

DEPRECATED: Integrating Jupyter with Databricks via SSH

Baseline for Databricks Labs projects written in Python

Accelerator to rapidly deploy customized features for your business

No description.

No description.

An experimental tool to synchronize source Databricks deployment with a target Databricks deployment.

SIEM-to-Spark Transpiler

DeltaOMS is a solution that help build a centralized repository of Delta Transaction logs and associated operational metrics/statistics for your Delta Lakehouse. Unity Catalog supported in the v0.7.0-rc1 release.Documentation here - https://databrickslabs.github.io/delta-oms/v0.7.0-rc1/

Lightweight SQL execution wrapper only on top of Databricks SDK

Run coding agents on Databricks Apps 🚀

Databricks Plugin for PyLint

Databricks Add-on for Splunk

Databricks SDK for R (Experimental)

No description.

Delta Sharing + MLflow for ML model & experiment exchange (arcuate delta - a fan shaped river delta)

Large-scale time-series measurement data analytics on Apache Spark

A Java connector for delta.io/sharing/ that allows you to easily ingest data on any JVM.

No description.

GeoBrix is a high-performance spatial processing library.

No description.

Automated provisioning of an industry Lakehouse with enterprise data model

No description.

No description.

A companion Databricks App for the Meta Conversions API marketplace listing. Provides a guided setup experience for connecting your Databricks lakehouse to Meta's Conversions API (CAPI).