⬡PipelineDevOps & InfraFree
Mage AI
Modern open-source data pipeline builder with an interactive code editor, real-time execution, and built-in ML integrations.
Installs110k
Rating★ 4.7
Reviews37
Mage AI
Mage is a modern replacement for legacy batch ETL and orchestration tools. It combines a Jupyter-style block editor with a full orchestration engine — build pipelines as code, see results in real-time, schedule runs, and deploy to any cloud with a single command.
Key Features
- Block-based pipelines — compose data pipelines from Data Loader, Transformer, and Exporter blocks
- Interactive IDE — in-browser notebook-style editor with live output after each block run
- Streaming support — first-class support for Kafka, Kinesis, and event-driven pipelines
- dbt integration — run dbt models as pipeline blocks with lineage visualization
- Scheduling & triggers — cron, event-based, and API-triggered runs; dependency-aware scheduling
- Observability — built-in pipeline run history, backfills, alerting, and SLA tracking
- AI Assist — AI-generated block code from natural language descriptions
- One-command deploy — deploy to GCP, AWS, Azure, or bare-metal Kubernetes with Terraform configs included
Quick Start
pip install mage-ai
mage start my_project
# Open http://localhost:6789
Install via ai-supply
npx ai-supply add mage-ai-data-pipeline-builder
Curated mirror of the open-source Mage AI (Apache-2.0). Get it from the source.