Skip to content
ai-supply.store
EntdeckenKategorienBestenlistenCommunityAgent APIFAQ
AnmeldenKostenlos registrieren
catalog / DevOps & Infra / Aim
△EvalDevOps & InfraFree

Aim

Self-hosted, open-source ML training metadata tracker with a powerful exploratory web UI.

@ai-supply
Installationen112k
⟳ upstream v3.29.1 · updated 1y ago
↗ Quell-Repository
← More DevOps & InfraDevOps & Infra leaderboard →How we grade security →Source ↗
! Grade B · 75/100 · ReviewSecurity assessment
✓No compromise signals19capabilities surfaced1known CVE5of 20 OWASP controls clear
Broad capability surfacePotentially unbounded loopnpm install-lifecycle scriptLow-confidence secret match
scanned 18d ago·osv · gitleaks · opengrep · picklescan + heuristics·full breakdown in the Security tab ↓

Aim

Aim is a self-hosted, open-source experiment tracking tool. It logs training metadata — metrics, hyperparameters, text, images, audio, video — and provides a powerful web UI for exploring thousands of runs simultaneously. Unlike hosted solutions, all data stays on your infrastructure.

Key Features

  • Local-first: all tracking data stays in a local .aim repo — no account needed
  • Exploratory UI: query runs with a SQL-like expression language and visualize anything
  • Multi-modal logging: metrics, images, audio, video, text, distributions, figures
  • Remote tracking server: centralize tracking for a team without SaaS
  • Deep integrations: PyTorch Lightning, Keras, XGBoost, Optuna, Hugging Face, Comet
  • Python SDK for fine-grained control

Quick Start

from aim import Run

run = Run()
run["hparams"] = {"lr": 0.001, "batch_size": 32}

for step in range(100):
    run.track(loss, name="loss", step=step)
    run.track(acc, name="accuracy", step=step)
# Launch the UI
aim up

Install via ai-supply

npx ai-supply add aim-training-metadata-ui

Curated mirror of the open-source Aim (Apache-2.0). Get it from the source.

Rating rank
#1
of 23 in DevOps & Infra
Install rank
#10
of 23 in DevOps & Infra
Security score
75/100 · B
review
Security rank
#15
of 23 in DevOps & Infra
Installs
112k
cat avg 212k
This listing vs category average
Installs
this
cat avg
Security (of 100)
this
cat avg
Adoption trend
See the DevOps & Infra leaderboard →
! Security: Review · 7575/100 · grade Bscanned 18d ago
✓ no compromise signals20 risk-surface · 10/20 OWASP controls flagged

Compromise signals — malicious or tampered code (leaked secrets, backdoors, a dropped executable) — reduce the score, and known dependency CVEs carry a bounded penalty (they warrant review but never QUARANTINE — update the dependency to clear). Other dangerous-by-capability traits are risk surface, expected for some capabilities. Every finding is mapped to its OWASP control below.

Control card · high confidence (static)
framework: pytestcovers: secrets-leakcovers: robustness
stringscanscheck_startup_successvalidate_commandcheck_configurationcheck_intervalcheck_sshfs_installationcheck_directory_permissions

Findings mapped to the OWASP Top 10 for LLM Applications (2025) and the OWASP Machine Learning Security Top 10. Expand any flagged control for the exact findings — compromise reduces the score; expected/risk-surface do not, except a known CVE, which carries a small bounded penalty (high/critical → Review).

OWASP Top 10 for LLM Applications
⚠LLM03Supply Chaincritical
Vulnerable/compromised dependencies, models or archives in the artifact.
•Dependency manifest — 124 npm dependencies declared · aimhubio-aim-6e098e3/aim/web/ui/package.jsonrisk surface
•npm install-lifecycle script — preinstall, postinstall run on install — executes arbitrary code · aimhubio-aim-6e098e3/aim/web/ui/package.json (CWE-506)risk surface
•Vulnerable dependencies — 212 known vulnerabilities in: @babel/core@7.12.3, @babel/core@7.12.9, @babel/core@7.20.2, @babel/helpers@7.20.1, @babel/plugin-transform-modules-systemjs@7.14.5, @babel/runtime@7.12.1, @babel/runtime@7.15.4, @babel/runtime@7.21.0 (CWE-1395)known CVE · -25 pts
⚠LLM02Sensitive Information Disclosurehigh
Secrets, credentials or PII shipped inside the artifact.
•Email addresses present — contains email-like strings · aimhubio-aim-6e098e3/.github/workflows/nightly-release.ymlexpected
•Phone number present — contains phone number-like pattern (E.164 or formatted) · aimhubio-aim-6e098e3/README.md (CWE-359)expected
•Credit-card-like number — a number passes the Luhn checksum · aimhubio-aim-6e098e3/aim/storage/hashing/hashing.py (CWE-359)expected
•Low-confidence secret match — 2 possible: generic-api-key · aimhubio-aim-6e098e3/aim/web/ui/src/services/analytics.ts (CWE-798)risk surface
⚠LLM08Vector and Embedding Weaknesseshigh
PII or plaintext source leakage in embedding/vector exports.
Embedding inversion/poisoning is largely runtime; static check covers PII in vector exports.
•Email addresses present — contains email-like strings · aimhubio-aim-6e098e3/.github/workflows/nightly-release.ymlexpected
•Phone number present — contains phone number-like pattern (E.164 or formatted) · aimhubio-aim-6e098e3/README.md (CWE-359)expected
•Credit-card-like number — a number passes the Luhn checksum · aimhubio-aim-6e098e3/aim/storage/hashing/hashing.py (CWE-359)expected
⚠LLM05Improper Output Handlingmedium
Code that pipes model/user output into shell, eval, SQL or paths unsafely.
•Suspicious code patterns — child_process exec; OS command execution · aimhubio-aim-6e098e3/aim/cli/manager/manager.py (CWE-78)expected
•Suspicious code patterns — OS command execution · aimhubio-aim-6e098e3/aim/cli/utils.py (CWE-78)expected
•Suspicious code patterns — dynamic code execution · aimhubio-aim-6e098e3/aim/storage/query.py (CWE-95)expected
⚠LLM06Excessive Agencymedium
Over-broad tool/permission surface or unrestricted egress.
•External endpoints declared — 1 distinct host(s) · aimhubio-aim-6e098e3/.github/ISSUE_TEMPLATE/config.ymlexpected
•Broad capability surface — 3 high-impact capability categories referenced — verify least-privilege · aimhubio-aim-6e098e3/CHANGELOG.md (CWE-272)risk surface
•External endpoints declared — 2 distinct host(s) · aimhubio-aim-6e098e3/CITATION.cffexpected
•External endpoints declared — 6 distinct host(s) · aimhubio-aim-6e098e3/CONTRIBUTING.mdexpected
•External endpoints declared — 14 distinct host(s) · aimhubio-aim-6e098e3/README.mdexpected
•External endpoints declared — 5 distinct host(s) · aimhubio-aim-6e098e3/aim/web/ui/public/index.htmlexpected
•External endpoints declared — 3 distinct host(s) · aimhubio-aim-6e098e3/aim/web/ui/src/config/references/index.tsexpected
⚠LLM10Unbounded Consumptionmedium
Unbounded loops/recursion causing DoS or runaway cost.
Enforced at runtime by the gateway (rate limits + spend caps + size caps); static check flags unbounded loops.
•Potentially unbounded loop — an infinite loop (while True / while(1) / for(;;)) may cause runaway consumption · aimhubio-aim-6e098e3/aim/ext/cleanup/__init__.py (CWE-835)risk surface
⚠LLM07System Prompt Leakagelow
Secrets, internal hosts or proprietary logic exposed in shipped prompts.
•Low-confidence secret match — 2 possible: generic-api-key · aimhubio-aim-6e098e3/aim/web/ui/src/services/analytics.ts (CWE-798)risk surface
§LLM09MisinformationGovernance
Artifacts designed to produce false/deceptive output.
Detectable only by runtime behavioral evaluation; addressed via responsible-use attestation.
✓LLM01Prompt InjectionPassed
✓LLM04Data and Model PoisoningPassed
Backdoors/poisoning in training data or serialized models.
Behavioral poisoning needs model execution; static check covers unsafe serialization + dataset skew only.
OWASP Machine Learning Security Top 10
⚠ML06AI Supply Chaincritical
Compromised PyPI/npm packages, typosquats, unsafe serialized models.
•Dependency manifest — 124 npm dependencies declared · aimhubio-aim-6e098e3/aim/web/ui/package.jsonrisk surface
•npm install-lifecycle script — preinstall, postinstall run on install — executes arbitrary code · aimhubio-aim-6e098e3/aim/web/ui/package.json (CWE-506)risk surface
•Vulnerable dependencies — 212 known vulnerabilities in: @babel/core@7.12.3, @babel/core@7.12.9, @babel/core@7.20.2, @babel/helpers@7.20.1, @babel/plugin-transform-modules-systemjs@7.14.5, @babel/runtime@7.12.1, @babel/runtime@7.15.4, @babel/runtime@7.21.0 (CWE-1395)known CVE · -25 pts
⚠ML02Data Poisoninghigh
Poisoned training datasets with triggers or anomalous distributions.
Static check covers trigger phrasing, PII and label skew; full poisoning detection is runtime.
•Email addresses present — contains email-like strings · aimhubio-aim-6e098e3/.github/workflows/nightly-release.ymlexpected
•Phone number present — contains phone number-like pattern (E.164 or formatted) · aimhubio-aim-6e098e3/README.md (CWE-359)expected
•Credit-card-like number — a number passes the Luhn checksum · aimhubio-aim-6e098e3/aim/storage/hashing/hashing.py (CWE-359)expected
⚠ML09Output Integritymedium
Middleware tampering with model outputs in transit.
Gateway enforces TLS + response integrity; static check flags output-rewriting code.
•Suspicious code patterns — child_process exec; OS command execution · aimhubio-aim-6e098e3/aim/cli/manager/manager.py (CWE-78)expected
•Suspicious code patterns — OS command execution · aimhubio-aim-6e098e3/aim/cli/utils.py (CWE-78)expected
•Suspicious code patterns — dynamic code execution · aimhubio-aim-6e098e3/aim/storage/query.py (CWE-95)expected
§ML01Input Manipulation (Adversarial)Governance
Models vulnerable to adversarial perturbations.
Requires runtime robustness evaluation; addressed via publisher robustness attestation.
§ML03Model InversionGovernance
Training data reconstructable from a model's outputs.
Runtime/evaluation property; addressed via model-card data-provenance + DP attestation.
§ML04Membership InferenceGovernance
Determining whether a record was in the training set.
Runtime/evaluation property; addressed via overfitting disclosure + DP attestation.
§ML08Model SkewingGovernance
Models trained on skewed data producing biased output.
Requires fairness evaluation; addressed via model-card bias/limitations disclosure.
✓ML05Model TheftPassed
Unlicensed re-distribution / license-incompatible derivatives.
Static check verifies license declaration; extraction throttling is runtime.
✓ML07Transfer Learning AttackPassed
Backdoored base models / LoRA adapters propagating to derivatives.
Backdoor detection needs behavioral probing; static check covers unsafe serialization + provenance.
✓ML10Model Poisoning (Weights)Passed
Tampered model weight files; integrity must be verifiable.
Static check enforces safe formats + records a content hash for downstream verification.
Other findings (22) · hygiene / uncategorized
•Unrecognized file type — '.coveragerc' is not on the allowlist · aimhubio-aim-6e098e3/.coveragercrisk surface
•Unrecognized file type — '.gitattributes' is not on the allowlist · aimhubio-aim-6e098e3/.gitattributesrisk surface
•Unrecognized file type — '.?' is not on the allowlist · aimhubio-aim-6e098e3/.github/CODEOWNERSrisk surface
•Unrecognized file type — '.gitignore' is not on the allowlist · aimhubio-aim-6e098e3/.gitignorerisk surface
•Unrecognized file type — '.cff' is not on the allowlist · aimhubio-aim-6e098e3/CITATION.cffrisk surface
•Unrecognized file type — '.in' is not on the allowlist · aimhubio-aim-6e098e3/MANIFEST.inrisk surface
•Unrecognized file type — '.pxd' is not on the allowlist · aimhubio-aim-6e098e3/aim/storage/arrayview.pxdrisk surface
•Unrecognized file type — '.pyx' is not on the allowlist · aimhubio-aim-6e098e3/aim/storage/encoding/encoding.pyxrisk surface
•Unrecognized file type — '.pyi' is not on the allowlist · aimhubio-aim-6e098e3/aim/storage/hashing/c_hash.pyirisk surface
•Unrecognized file type — '.pyxbld' is not on the allowlist · aimhubio-aim-6e098e3/aim/storage/hashing/c_hash.pyxbldrisk surface
•Unrecognized file type — '.h' is not on the allowlist · aimhubio-aim-6e098e3/aim/storage/hashing/hash/hash.hrisk surface
•Unrecognized file type — '.ini' is not on the allowlist · aimhubio-aim-6e098e3/aim/storage/migrations/alembic.inirisk surface
•Unrecognized file type — '.mako' is not on the allowlist · aimhubio-aim-6e098e3/aim/storage/migrations/script.py.makorisk surface
•Unrecognized file type — '.editorconfig' is not on the allowlist · aimhubio-aim-6e098e3/aim/web/ui/.editorconfigrisk surface
•Unrecognized file type — '.eslintrc' is not on the allowlist · aimhubio-aim-6e098e3/aim/web/ui/.eslintrcrisk surface
•Unrecognized file type — '.npmrc' is not on the allowlist · aimhubio-aim-6e098e3/aim/web/ui/.npmrcrisk surface
•Unrecognized file type — '.prettierrc' is not on the allowlist · aimhubio-aim-6e098e3/aim/web/ui/.prettierrcrisk surface
•Unrecognized file type — '.scss' is not on the allowlist · aimhubio-aim-6e098e3/aim/web/ui/src/App.scssrisk surface
•Unrecognized file type — '.snap' is not on the allowlist · aimhubio-aim-6e098e3/aim/web/ui/src/components/kit/Input/__snapshots__/Input.test.tsx.snaprisk surface
•Suspicious network references — URL shortener (1 URLs) · aimhubio-aim-6e098e3/aim/web/ui/src/components/kit/Input/__snapshots__/Input.test.tsx.snapexpected
•Suspicious network references — URL shortener (2 URLs) · aimhubio-aim-6e098e3/aim/web/ui/src/components/kit_v2/Icon/__snapshots__/Icon.test.tsx.snapexpected
•Suspicious network references — raw IP URL (2 URLs) · aimhubio-aim-6e098e3/aim/web/ui/src/config/config.tsexpected
✔ verified source · pinned aimhubio-aim-6e098e3
Check against a policy

The same gate an agent runs before installing (POST /api/v1/trust/aim-training-metadata-ui/check). Click a policy:

Consume Aim programmatically. Authenticate with an API key or session — see Authorize an agent.

# Agents: CHECK BEFORE YOU INSTALL (no auth) — score, grade, level, capability manifest
curl https://ai-supply.store/api/v1/trust/aim-training-metadata-ui

# Gate against your org policy (returns { pass, violations })
curl -X POST https://ai-supply.store/api/v1/trust/aim-training-metadata-ui/check \
  -H "Content-Type: application/json" \
  -d '{"minGrade":"B","denyPermissions":["shell"],"denyUnknownEgress":true}'

# CLI
npx ai-supply add aim-training-metadata-ui

# REST (install → download)
curl -X POST https://ai-supply.store/api/v1/listings/aim-training-metadata-ui/install \
  -H "Authorization: Bearer $AIM_KEY"

# MCP tool
install_listing({ "slug": "aim-training-metadata-ui" })
OpenAPI spec →
vlatest
! Security: Review · 751mo ago

Curated mirror — latest upstream source. See the repository for tagged releases.

Sign in and install this listing to leave a review.

More from @ai-supply

View profile →
◉Agent
MetaGPT
Multi-agent framework that assigns GPT roles (PM, engineer, QA) to solve complex software tasks end-to-end.
↓ 1.0M
⇄Connector
vLLM
High-throughput, memory-efficient LLM inference engine with PagedAttention and continuous batching.
↓ 892k
⇄Connector
Meilisearch
Lightning-fast open-source search engine with typo-tolerance, semantic hybrid search, and sub-50ms response times.
↓ 811k
△Eval
Weights & Biases (wandb)
ML experiment tracking and visualization — log metrics, hyperparameters, models, and media in real time.
↓ 784k
ai-supply.store

Kostenlose, sicherheitsgeprüfte KI-Fähigkeiten – Skills, MCPs, Plugins, Agents, Datasets und mehr, jeweils bewertet und auf Aktualität überwacht, gemacht für Menschen und Agents gleichermaßen.

api · v3.1status · all green
Kontakt
support@ai-supply.storesecurity@ai-supply.store
Katalog
  • Entdecken
  • Kategorien
  • Bestenlisten
  • Benchmarks
  • Sicherheit
  • Scan a repo
Community
  • Community
  • FAQ
Für Agenten
  • Schnellstart (60s)
  • Agenten autorisieren
  • Agent API
  • OpenAPI-Spezifikation
Für Entwickler
  • Veröffentlichen
  • Dashboard
Konto
  • Konto erstellen
  • Anmelden
  • Einstellungen
Rechtliches
  • Nutzungsbedingungen
  • Publisher-Vereinbarung
  • Nutzungsrichtlinien
  • Datenschutz