Schemathesis
Generate and run property-based tests against any OpenAPI or GraphQL API to automatically surface crashes and spec violations.
Schemathesis
Schemathesis reads your OpenAPI or GraphQL schema and automatically generates test cases that probe every endpoint with valid and adversarial inputs. Built on Hypothesis, it uses property-based testing to find responses that violate the schema, crash the server, or expose edge-case bugs — no hand-written test suite required.
Key features
- Auto-derives thousands of test cases straight from your API schema
- Property-based fuzzing that shrinks failures to minimal reproductions
- Stateful testing that chains operations to find sequence-dependent bugs
- Runs as a CLI or pytest integration; fits CI pipelines
- Conformance checks: status codes, schemas, content types, and headers
A focused test-generation tool for API teams: point it at a spec and it manufactures the coverage, catching contract regressions before users do.
Curated mirror of the open-source Schemathesis (MIT). Get it from the source.
Compromise signals — malicious or tampered code (leaked secrets, backdoors, a dropped executable) — reduce the score, and known dependency CVEs carry a bounded penalty (they warrant review but never QUARANTINE — update the dependency to clear). Other dangerous-by-capability traits are risk surface, expected for some capabilities. Every finding is mapped to its OWASP control below.
Findings mapped to the OWASP Top 10 for LLM Applications (2025) and the OWASP Machine Learning Security Top 10. Expand any flagged control for the exact findings — compromise reduces the score; expected/risk-surface do not, except a known CVE, which carries a small bounded penalty (high/critical → Review).
The same gate an agent runs before installing (POST /api/v1/trust/schemathesis-api-test-generator/check). Click a policy:
Consume Schemathesis programmatically. Authenticate with an API key or session — see Authorize an agent.
# Agents: CHECK BEFORE YOU INSTALL (no auth) — score, grade, level, capability manifest
curl https://ai-supply.store/api/v1/trust/schemathesis-api-test-generator
# Gate against your org policy (returns { pass, violations })
curl -X POST https://ai-supply.store/api/v1/trust/schemathesis-api-test-generator/check \
-H "Content-Type: application/json" \
-d '{"minGrade":"B","denyPermissions":["shell"],"denyUnknownEgress":true}'
# CLI
npx ai-supply add schemathesis-api-test-generator
# REST (install → download)
curl -X POST https://ai-supply.store/api/v1/listings/schemathesis-api-test-generator/install \
-H "Authorization: Bearer $AIM_KEY"
# MCP tool
install_listing({ "slug": "schemathesis-api-test-generator" })OpenAPI spec →Curated mirror — latest upstream source. See the repository for tagged releases.