Category

DevOps & Infra

CI/CD, IaC, observability, incident response.

23 listings

Every DevOps & Infra listing on ai-supply is a free, open-source AI capability that we scan and grade A–D for security before it appears here — so you can adopt with confidence, not just a star count. This category spans 7 Evals, 5 Connectors, 5 MCP servers, 4 Pipelines and 2 Workflows.

Security posture: 9 of 23 scanned rated safe · avg score 87/100.

DevOps & Infra leaderboard →How we grade security →Security findings →All categories →

High-throughput, memory-efficient LLM inference engine with PagedAttention and continuous batching.

! B · 88⟳ 6d agoshellinstall-hooknetwork

Weights & Biases (wandb)

ML experiment tracking and visualization — log metrics, hyperparameters, models, and media in real time.

✓ A · 95⟳ 6d agoguards:4

End-to-end ML lifecycle platform — experiment tracking, model registry, serving, and LLM evaluation.

! B · 88⟳ 14d agoguards:3

Distributed Python framework for scaling ML workloads — training, serving, hyperparameter tuning, and pipelines.

✓ A · 100⟳ 7d agosecretsshellinstall-hook

Apache-2.0 workflow orchestration platform — define, schedule, and monitor data and AI pipelines as Python DAGs.

! B · 88⟳ 5d agosecretsshellnetwork

Fast LLM serving framework with RadixAttention KV cache reuse and structured output (JSON/regex) natively.

✓ A · 100⟳ 10d agoshellnetworkfs

Build, ship, and scale AI services — unified framework from local development to production Kubernetes.

! B · 75⟳ 3mo agoshellnetworkfs

Production LLM serving platform by BentoML — deploy any open-source LLM with one command.

! B · 75⟳ 1y agoshellnetworkfs

Open-source ML and LLM observability framework for evaluating, monitoring, and testing AI system quality.

! B · 75⟳ 5mo agoguards:7

Self-hosted, open-source ML training metadata tracker with a powerful exploratory web UI.

! B · 75⟳ 1y agoguards:2

Modern open-source data pipeline builder with an interactive code editor, real-time execution, and built-in ML integrations.

! B · 75⟳ 6mo agosecretsshellnetwork

Apache-2.0 LLM testing framework — pytest-style unit tests for RAG pipelines, chatbots, and LLM outputs.

! B · 75⟳ 19d agoguards:5

Modern workflow orchestration — turn any Python function into a scheduled, observable, retriable data or AI pipeline with zero boilerplate.

! B · 88⟳ 4d agosecretsshellnetwork

Framework-agnostic MLOps framework — build portable, production-ready ML pipelines that run anywhere.

✓ A · 100⟳ 10d agosecretsshellnetwork

OpenTelemetry-based observability SDK for LLM applications — traces, metrics, and logs for any AI framework.

! B · 75⟳ 7d agonetwork

LLM eval + red-teaming framework — test prompts and models against custom assertions, compare providers, and catch regressions in CI.

✓ A · 100⟳ 13d agoguards:7

Git-like version control for ML datasets and pipelines — track experiments, reproduce results, and collaborate on data science projects.

✓ A · 100⟳ 4mo agosecretsshellnetwork

Opik (by Comet)

Open-source LLM evaluation and observability platform — trace, test, and monitor LLM apps end-to-end.

✓ A · 100⟳ 3d agoguards:3

◇MCP 服务器

AWS MCP Servers

AWS Labs' suite of MCP servers for AWS docs, infrastructure, containers, databases, and cost analysis.

! B · 75⟳ 4d agoshellnetworkfs

◇MCP 服务器

Cloudflare MCP Servers

Official MCP servers to operate Cloudflare services (Workers, DNS, observability, security) via natural language.

! B · 75⟳ 6d agoinstall-hooknetworkfs

◇MCP 服务器

Grafana MCP Server

Official MCP server exposing Grafana dashboards, datasource queries, alerts, and incidents to AI agents.

! B · 88⟳ 7d agoshellnetworkfs

◇MCP 服务器

Kubernetes MCP Server

MCP server that lets agents run kubectl and Helm operations to inspect and manage Kubernetes clusters.

✓ A · 100⟳ 9d agoshellnetworkfs

◇MCP 服务器

Terraform MCP Server

MCP server for the Terraform Registry and HCP Terraform — providers, modules, and workspace automation.

✓ A · 100⟳ 13d agonetwork