Category

DevOps & Infra

CI/CD, IaC, observability, incident response.

23 listings

Every DevOps & Infra listing on ai-supply is a free, open-source AI capability that we scan and grade A–D for security before it appears here — so you can adopt with confidence, not just a star count. This category spans 7 Evals, 5 Connectors, 5 MCP servers, 4 Pipelines and 2 Workflows.

Security posture: 10 of 23 scanned rated safe · avg score 87/100.

DevOps & Infra leaderboard →How we grade security →Security findings →All categories →

High-throughput, memory-efficient LLM inference engine with PagedAttention and continuous batching.

! B · 88⟳ 11d agoshellinstall-hooknetwork

Weights & Biases (wandb)

ML experiment tracking and visualization — log metrics, hyperparameters, models, and media in real time.

✓ A · 95⟳ 9d agoguards:4

End-to-end ML lifecycle platform — experiment tracking, model registry, serving, and LLM evaluation.

! B · 88⟳ 1mo agoguards:3

Distributed Python framework for scaling ML workloads — training, serving, hyperparameter tuning, and pipelines.

! B · 88⟳ 8d agosecretsshellinstall-hook

Apache-2.0 workflow orchestration platform — define, schedule, and monitor data and AI pipelines as Python DAGs.

! B · 88⟳ 19d agosecretsshellnetwork

Fast LLM serving framework with RadixAttention KV cache reuse and structured output (JSON/regex) natively.

✓ A · 100⟳ 11d agoshellnetworkfs

Build, ship, and scale AI services — unified framework from local development to production Kubernetes.

! B · 75⟳ 2mo agoshellnetworkfs

Production LLM serving platform by BentoML — deploy any open-source LLM with one command.

! B · 75⟳ 1y agoshellnetworkfs

Open-source ML and LLM observability framework for evaluating, monitoring, and testing AI system quality.

! B · 75⟳ 4mo agoguards:7

Self-hosted, open-source ML training metadata tracker with a powerful exploratory web UI.

! B · 75⟳ 1y agoguards:2

Modern open-source data pipeline builder with an interactive code editor, real-time execution, and built-in ML integrations.

! B · 75⟳ 6mo agosecretsshellnetwork

Apache-2.0 LLM testing framework — pytest-style unit tests for RAG pipelines, chatbots, and LLM outputs.

! B · 75⟳ 13d agoguards:5

Modern workflow orchestration — turn any Python function into a scheduled, observable, retriable data or AI pipeline with zero boilerplate.

✓ A · 95⟳ 16d agosecretsshellnetwork

Framework-agnostic MLOps framework — build portable, production-ready ML pipelines that run anywhere.

✓ A · 100⟳ 8d agosecretsshellnetwork

OpenTelemetry-based observability SDK for LLM applications — traces, metrics, and logs for any AI framework.

! B · 75⟳ 27d agonetwork

LLM eval + red-teaming framework — test prompts and models against custom assertions, compare providers, and catch regressions in CI.

✓ A · 100⟳ 11d agoguards:7

Git-like version control for ML datasets and pipelines — track experiments, reproduce results, and collaborate on data science projects.

✓ A · 100⟳ 3mo agosecretsshellnetwork

Opik (by Comet)

Open-source LLM evaluation and observability platform — trace, test, and monitor LLM apps end-to-end.

✓ A · 100⟳ 8d agoguards:3

AWS MCP Servers

AWS Labs' suite of MCP servers for AWS docs, infrastructure, containers, databases, and cost analysis.

! B · 75⟳ 12d agoshellnetworkfs

Cloudflare MCP Servers

Official MCP servers to operate Cloudflare services (Workers, DNS, observability, security) via natural language.

! B · 75⟳ 9d agoinstall-hooknetworkfs

Grafana MCP Server

Official MCP server exposing Grafana dashboards, datasource queries, alerts, and incidents to AI agents.

✓ A · 95⟳ 12d agoshellnetworkfs

Kubernetes MCP Server

MCP server that lets agents run kubectl and Helm operations to inspect and manage Kubernetes clusters.

✓ A · 100⟳ 7d agoshellnetworkfs

Terraform MCP Server

MCP server for the Terraform Registry and HCP Terraform — providers, modules, and workspace automation.

✓ A · 100⟳ 11d agonetwork