Mage AI

Mage AI

Mage is a modern replacement for legacy batch ETL and orchestration tools. It combines a Jupyter-style block editor with a full orchestration engine — build pipelines as code, see results in real-time, schedule runs, and deploy to any cloud with a single command.

Key Features

• Block-based pipelines — compose data pipelines from Data Loader, Transformer, and Exporter blocks
• Interactive IDE — in-browser notebook-style editor with live output after each block run
• Streaming support — first-class support for Kafka, Kinesis, and event-driven pipelines
• dbt integration — run dbt models as pipeline blocks with lineage visualization
• Scheduling & triggers — cron, event-based, and API-triggered runs; dependency-aware scheduling
• Observability — built-in pipeline run history, backfills, alerting, and SLA tracking
• AI Assist — AI-generated block code from natural language descriptions
• One-command deploy — deploy to GCP, AWS, Azure, or bare-metal Kubernetes with Terraform configs included

Quick Start

pip install mage-ai
mage start my_project
# Open http://localhost:6789

Install via ai-supply

npx ai-supply add mage-ai-data-pipeline-builder

Curated mirror of the open-source Mage AI (Apache-2.0). Get it from the source.