Skip to content
ai-supply.store
DécouvrirCatégoriesClassementsCommunautéAgent APIFAQ
Se connecterInscription gratuite
catalog / Language & NLP / Anthropic HH-RLHF Dataset
▣DatasetLanguage & NLPFree

Anthropic HH-RLHF Dataset

Anthropic's human-preference (helpful/harmless) dataset for RLHF and alignment research.

@ai-supply
Installations51k
↗ Dépôt source
← More Language & NLPLanguage & NLP leaderboard →How we grade security →Source ↗

Anthropic HH-RLHF Dataset

The human preference dataset released with Anthropic's 'Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback' work — pairs of model responses labeled for helpfulness and harmlessness, plus red-teaming data.

It is a standard resource for preference modeling, reward-model training, and safety/alignment research.

MIT licensed. The repository is archived (read-only) but remains a widely cited reference dataset.

Rating rank
#1
of 30 in Language & NLP
Install rank
#16
of 30 in Language & NLP
Security score
100/100 · A
safe
Security rank
#1
of 30 in Language & NLP
Installs
51k
cat avg 145k
This listing vs category average
Installs
this
cat avg
Security (of 100)
this
cat avg
Adoption trend
See the Language & NLP leaderboard →
✓ Security: Safe · 100100/100 · grade Ascanned 15h ago
✓ no compromise signals1 risk-surface · 4/20 OWASP controls flagged

Compromise signals — malicious or tampered code (leaked secrets, backdoors, a dropped executable) — reduce the score, and known dependency CVEs carry a bounded penalty (they warrant review but never QUARANTINE — update the dependency to clear). Other dangerous-by-capability traits are risk surface, expected for some capabilities. Every finding is mapped to its OWASP control below.

Data card · low confidence (static)
license: detected
PII surface: Email addresses present
12 files

Findings mapped to the OWASP Top 10 for LLM Applications (2025) and the OWASP Machine Learning Security Top 10. Expand any flagged control for the exact findings — compromise reduces the score; expected/risk-surface do not.

OWASP Top 10 for LLM Applications
⚠LLM02Sensitive Information Disclosuremedium
Secrets, credentials or PII shipped inside the artifact.
•Email addresses present — contains email-like strings · anthropics-hh-rlhf-c72f5ce/README.mdrisk surface
⚠LLM08Vector and Embedding Weaknessesmedium
PII or plaintext source leakage in embedding/vector exports.
Embedding inversion/poisoning is largely runtime; static check covers PII in vector exports.
•Email addresses present — contains email-like strings · anthropics-hh-rlhf-c72f5ce/README.mdrisk surface
§LLM09MisinformationGovernance
Artifacts designed to produce false/deceptive output.
Detectable only by runtime behavioral evaluation; addressed via responsible-use attestation.
◷LLM10Unbounded ConsumptionRuntime-enforced
Unbounded loops/recursion causing DoS or runaway cost.
Enforced at runtime by the gateway (rate limits + spend caps + size caps); static check flags unbounded loops.
✓LLM01Prompt InjectionPassed
✓LLM03Supply ChainPassed
✓LLM04Data and Model PoisoningPassed
Backdoors/poisoning in training data or serialized models.
Behavioral poisoning needs model execution; static check covers unsafe serialization + dataset skew only.
✓LLM05Improper Output HandlingPassed
✓LLM06Excessive AgencyPassed
✓LLM07System Prompt LeakagePassed
OWASP Machine Learning Security Top 10
⚠ML02Data Poisoningmedium
Poisoned training datasets with triggers or anomalous distributions.
Static check covers trigger phrasing, PII and label skew; full poisoning detection is runtime.
•Email addresses present — contains email-like strings · anthropics-hh-rlhf-c72f5ce/README.mdrisk surface
⚠ML05Model Theftlow
Unlicensed re-distribution / license-incompatible derivatives.
Static check verifies license declaration; extraction throttling is runtime.
•No license signal — no SPDX id or license keyword found · anthropics-hh-rlhf-c72f5ce/.gitattributesrisk surface
§ML01Input Manipulation (Adversarial)Governance
Models vulnerable to adversarial perturbations.
Requires runtime robustness evaluation; addressed via publisher robustness attestation.
§ML03Model InversionGovernance
Training data reconstructable from a model's outputs.
Runtime/evaluation property; addressed via model-card data-provenance + DP attestation.
§ML04Membership InferenceGovernance
Determining whether a record was in the training set.
Runtime/evaluation property; addressed via overfitting disclosure + DP attestation.
§ML08Model SkewingGovernance
Models trained on skewed data producing biased output.
Requires fairness evaluation; addressed via model-card bias/limitations disclosure.
◷ML09Output IntegrityRuntime-enforced
Middleware tampering with model outputs in transit.
Gateway enforces TLS + response integrity; static check flags output-rewriting code.
✓ML06AI Supply ChainPassed
✓ML07Transfer Learning AttackPassed
Backdoored base models / LoRA adapters propagating to derivatives.
Backdoor detection needs behavioral probing; static check covers unsafe serialization + provenance.
✓ML10Model Poisoning (Weights)Passed
Tampered model weight files; integrity must be verifiable.
Static check enforces safe formats + records a content hash for downstream verification.
Other findings (2) · hygiene / uncategorized
•Unrecognized file type — '.gitattributes' is not on the allowlist · anthropics-hh-rlhf-c72f5ce/.gitattributesrisk surface
•Unrecognized file type — '.?' is not on the allowlist · anthropics-hh-rlhf-c72f5ce/LICENSErisk surface
✔ verified source · pinned anthropics-hh-rlhf-c72f5ce
Check against a policy

The same gate an agent runs before installing (POST /api/v1/trust/anthropic-hh-rlhf/check). Click a policy:

Consume Anthropic HH-RLHF Dataset programmatically. Authenticate with an API key or session — see Authorize an agent.

# Agents: CHECK BEFORE YOU INSTALL (no auth) — score, grade, level, capability manifest
curl https://ai-supply.store/api/v1/trust/anthropic-hh-rlhf

# Gate against your org policy (returns { pass, violations })
curl -X POST https://ai-supply.store/api/v1/trust/anthropic-hh-rlhf/check \
  -H "Content-Type: application/json" \
  -d '{"minGrade":"B","denyPermissions":["shell"],"denyUnknownEgress":true}'

# CLI
npx ai-supply add anthropic-hh-rlhf

# REST (install → download)
curl -X POST https://ai-supply.store/api/v1/listings/anthropic-hh-rlhf/install \
  -H "Authorization: Bearer $AIM_KEY"

# MCP tool
install_listing({ "slug": "anthropic-hh-rlhf" })
OpenAPI spec →
vlatest
✓ Security: Safe · 10017h ago

Curated mirror — latest upstream source. See the repository for tagged releases.

Sign in and install this listing to leave a review.

More from @ai-supply

View profile →
◉Agent
MetaGPT
Multi-agent framework that assigns GPT roles (PM, engineer, QA) to solve complex software tasks end-to-end.
↓ 1.0M
⇄Connector
vLLM
High-throughput, memory-efficient LLM inference engine with PagedAttention and continuous batching.
↓ 892k
⇄Connector
Meilisearch
Lightning-fast open-source search engine with typo-tolerance, semantic hybrid search, and sub-50ms response times.
↓ 811k
△Eval
Weights & Biases (wandb)
ML experiment tracking and visualization — log metrics, hyperparameters, models, and media in real time.
↓ 784k
ai-supply.store

Des capacités d'IA gratuites et vérifiées pour la sécurité — skills, MCP, plugins, agents, datasets et bien plus, chacune notée et suivie pour rester à jour, et pensée autant pour les humains que pour les agents.

api · v3.1status · all green
Contact
support@ai-supply.storesecurity@ai-supply.store
Catalogue
  • Découvrir
  • Catégories
  • Classements
  • Benchmarks
  • Sécurité
Communauté
  • Communauté
  • FAQ
Pour les agents
  • Démarrage rapide (60s)
  • Autoriser un agent
  • Agent API
  • Spécification OpenAPI
Pour les développeurs
  • Publier
  • Tableau de bord
Compte
  • Créer un compte
  • Se connecter
  • Paramètres
Mentions légales
  • Conditions
  • Accord éditeur
  • Utilisation acceptable
  • Confidentialité