Mage OSS Build modern data pipelines locally — fast, visual, and production-ready. Mage OSS is a self-hosted development environment designed to help teams create production-grade data pipelines with confidence. Ideal…
Mage OSS
Build modern data pipelines locally — fast, visual, and production-ready.
Mage OSS is a self-hosted development environment designed to help teams create production-grade data pipelines with confidence.
Ideal for automating ETL tasks, architecting data flow, or orchestrating transformations — all in a fast, notebook-style interface powered by modular code.
When it’s time to scale, Mage Pro — our core platform — unlocks enterprise orchestration, collaboration, and AI-powered workflows.
What you can do with Mage OSS
- Build pipelines locally with Python, SQL, or R in a modular notebook-style UI
- Run jobs manually or on a schedule (cron supported)
- Connect to databases, APIs, and cloud storage with prebuilt connectors
- Debug visually with logs, live previews, and step-by-step execution
- Set up quickly with Docker, pip, or conda — no cloud account required
- Your go-to workspace for local pipeline development — fully in your control.
Start local. Scale when you're ready.
Use Mage OSS to build and run pipelines on your machine. When you're ready for advanced tooling, performance, and AI-assisted productivity, Mage Pro is just one click away.
Quickstart
Install using Docker (recommended):
bash
docker pull mageai/mageai:latest
Or with pip:
bash
pip install mage-ai
Or with conda:
bash
conda install -c conda-forge mage-ai
Full setup guide and docs: docs.mage.ai
Core Features
| Feature | Description |
| :- | :- |
| Modular pipelines | Build pipelines block-by-block using Python, SQL, or R |
| Notebook UI | Interactive editor for writing and documenting logic |
| Data integrations | Prebuilt connectors to databases, APIs, and cloud storage |
| Scheduling | Trigger pipelines manually or on a schedule |
| Visual debugging | Step-by-step logs, data previews, and error handling |
| dbt support | Build and run dbt models directly inside Mage |
Example Use Cases
- Move data from Google Sheets to Snowflake with a Python transform
- Schedule a daily SQL pipeline to clean and aggregate product data
- Develop dbt models in a visual notebook-style interface
- Run simple ETL/ELT jobs locally with full transparency
Documentation
Looking for how-to guides, examples, or advanced configuration?
Explore our full documentation at docs.mage.ai.
Contributing
We welcome contributions of all kinds — bug fixes, docs, new features, or community examples.
Start with our contributing guide, check out open issues, or suggest improvements.
Ready to scale? Mage Pro has you covered.
Mage Pro is a powered-up platform built for teams.
It adds everything you need for production pipelines, at scale.
- Magical AI-assisted development and debugging
- Multi-environment orchestration
- Role-based access control
- Real-time monitoring & alerts
- Powerful CI/CD & version control
- Powerful enterprise features
- Available fully managed, hybrid, or on-premises
-
mage-ai
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Python ★ 8.8k 3d agoExplain → -
mage-zoomcamp
This repository will contain all of the resources for the Mage component of the Data Engineering Zoomcamp: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main
Dockerfile ★ 104 1y agoExplain → -
mage-ai-terraform-templates
Terraform templates for deploying mage-ai to AWS, GCP and Azure
HCL ★ 45 2y agoExplain → -
machine_learning
The definitive end-to-end machine learning (ML lifecycle) guide and tutorial for data engineers.
Python ★ 24 1y agoExplain → -
mlops
No description.
Python ★ 22 1y agoExplain → -
compose-quickstart
A quickstart repo for Mage using Docker compose.
Dockerfile ★ 19 2y agoExplain → -
helm-charts
No description.
Go Template ★ 12 2d agoExplain → -
magic-devcontainer
A demo instance of mage for pulling sample data from a public Google pub/sub topic and transforming with dbt.
Python ★ 12 2y agoExplain → -
dbt-quickstart
No description.
Python ★ 8 2y agoExplain → -
docker
Dockerfile and Docker compose templates
Dockerfile ★ 8 1y agoExplain → -
assets
Media assets used in repository documentation.
★ 7 1mo agoExplain → -
llm_orchestration
No description.
Python ★ 7 1y agoExplain → -
rag-project
No description.
Python ★ 7 1y agoExplain → -
datasets
Datasets to play with.
★ 5 6mo agoExplain → -
demo_etl_pipeline
Demo pipeline for loading, transforming, and exporting restaurant data.
Python ★ 3 2y agoExplain → -
mage-pro-advanced-demos
Advanced use cases in Mage Pro
Python ★ 3 8mo agoExplain → -
agent-plugin
No description.
★ 2 3d agoExplain → -
.github
No description.
★ 2 3y agoExplain → -
dbt-mysql ⑂
dbt-mysql contains all of the code enabling dbt to work with MySQL and MariaDB
Python ★ 2 1y agoExplain → -
etl-demo
Mage ELT demo for pulling data from an API, performing transformations, and writing to a local DuckDB database.
Python ★ 2 2y agoExplain → -
jupyter_client ⑂
Jupyter protocol client APIs
Python ★ 2 4y agoExplain → -
google-ads-python ⑂
Google Ads API Client Library for Python
Python ★ 2 2y agoExplain → -
sqlglot ⑂
Python SQL Parser and Transpiler
★ 2 2y agoExplain → -
mage-pro-finance
No description.
Python ★ 1 1y agoExplain → -
iceberg-python ⑂
Apache PyIceberg
Python ★ 1 7mo agoExplain → -
dbt-synapse ⑂
dbt adapter for Azure Synapse Dedicated SQL Pools
Python ★ 1 2y agoExplain → -
mage-finance ⑂
The definitive end-to-end machine learning (ML lifecycle) guide and tutorial for data engineers.
★ 1 1y agoExplain → -
platform_template
Mage project platform template for using multiple projects and other non-Mage projects in 1 Mage ultra project.
Python ★ 1 2y agoExplain → -
code-server ⑂
VS Code in the browser
★ 1 1y agoExplain → -
dbt-core ⑂
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
★ 1 2y agoExplain → -
demo_project
Demo project for quick start tutorial
Python ★ 1 3y agoExplain → -
llm-zoomcamp ⑂
LLM Zoomcamp - a free online course about building a Q&A system
Jupyter Notebook ★ 1 10d agoExplain → -
mage_demo_project
Demo project containing data integration pipelines and batch transformation pipelines.
Python ★ 1 8d agoExplain → -
singer-python ⑂
Writes the Singer format from Python
Python ★ 1 2y agoExplain → -
delta-rs ⑂
A native Rust library for Delta Lake, with bindings into Python and Ruby.
★ 1 3y agoExplain → -
mage-pro-releases
No description.
★ 0 3d agoExplain → -
mage-pipeline-examples
Example pipelines built with Mage, a data orchestration tool. Use these pipelines to learn, explore, and jumpstart your own data workflows with Mage.
★ 0 9mo agoExplain → -
mage-pro-embed-demo
No description.
TypeScript ★ 0 4mo agoExplain → -
pygls ⑂
A pythonic generic language server
★ 0 1y agoExplain → -
mlops-zoomcamp ⑂
Free MLOps course from DataTalks.Club
Jupyter Notebook ★ 0 1y agoExplain → -
mage-libpostal-docker
Sample Mage docker compose for building a docker image with libpostal
Python ★ 0 2y agoExplain → -
reaflow ⑂
🎯 React library for building workflow editors, flow charts and diagrams. Maintained by @goodcodeus.
★ 0 2y agoExplain → -
mage-ai-cdk
AWS Cloud Development Kit (CDK) scripts for deploying Mage to AWS
TypeScript ★ 0 3y agoExplain →
No repos match these filters.