Prompt flow

Prompt flow

Prompt flow is a suite of development tools designed to streamline the entire LLM application development lifecycle — from ideation and prototyping to testing, evaluation, and production deployment. It provides a visual graph of flow nodes, built-in evaluators, and CI/CD integration.

Key Features

• Visual DAG editor: Build LLM flows as connected nodes (LLM calls, Python functions, tools) with a drag-and-drop graph
• Flex flows: Python-first authoring with full control and no YAML required
• Batch evaluation: Run your flow over datasets and compute quality metrics automatically
• Built-in evaluators: Groundedness, relevance, coherence, fluency, and custom metric support
• Tracing: OpenTelemetry-compatible distributed tracing for debugging complex multi-step flows
• CI/CD ready: CLI + SDK for integrating quality gates into GitHub Actions or Azure Pipelines

Quick Start

pip install promptflow promptflow-tools

# Create a new flow
pf flow init --flow my-chat-flow --type chat

# Run the flow
pf flow test --flow my-chat-flow --inputs question="What is LLM?"

# Batch evaluate
pf run create --flow my-chat-flow --data data.jsonl

Add to ai-supply

npx ai-supply add promptflow-llm-pipeline

Curated mirror of the open-source Prompt flow (MIT). Get it from the source.