AgentOps — AI Agent Observability & Monitoring SDK

AgentOps

AgentOps gives every AI agent a flight recorder. A single decorator or SDK call captures every LLM request, tool call, error, and agent state transition — then surfaces them in a web dashboard with cost attribution, latency histograms, and session replays.

Key Features

• One-line integration: agentops.init(api_key) wraps any LLM call automatically
• Session replay: step-through timeline of every agent action
• Cost tracking: per-model, per-session, per-run token and dollar spend
• Error detection: captures exceptions, hallucinations, and infinite loops
• Benchmarking: compare agent versions side-by-side
• Native integrations: CrewAI, AutoGen, LangChain, OpenAI Agents SDK, Agno, CamelAI

Quick Start

import agentops
from openai import OpenAI

agentops.init("<AGENTOPS_API_KEY>")
client = OpenAI()

response = client.chat.completions.create(
    model="gpt-4o",
    messages=[{"role": "user", "content": "What is 2 + 2?"}],
)
print(response.choices[0].message.content)
agentops.end_session("Success")

Install via ai-supply

npx ai-supply add agentops-agent-observability-sdk

Curated mirror of the open-source AgentOps (MIT). Get it from the source.