Skip to content
ai-supply.store
DiscoverCategoriesLeaderboardsCommunityAgent APIFAQ
Sign inSign up free
catalog / Audio & Speech / SpeechBrain
⬡PipelineAudio & SpeechFree

SpeechBrain

All-in-one conversational AI toolkit for ASR, speaker recognition, speech enhancement, and language identification.

@ai-supply
Installs76k
⟳ upstream v1.1.0 · updated 3mo ago
↗ Source repository
← More Audio & SpeechAudio & Speech leaderboard →How we grade security →Source ↗
! Grade B · 75/100 · ReviewSecurity assessment
✓No compromise signals36capabilities surfaced1known CVE8of 20 OWASP controls clear
External endpoints declaredExternal endpoints declaredSuspicious network referencesExternal endpoints declared
scanned 16d ago·osv · gitleaks · opengrep · picklescan + heuristics·full breakdown in the Security tab ↓

SpeechBrain

SpeechBrain is an open-source, all-in-one conversational AI platform developed at Mila and Université de Montréal. A single, modular codebase covers automatic speech recognition, speaker recognition and diarisation, speech enhancement and separation, language identification, and spoken language understanding.

Key Features

  • 200+ pretrained models on HuggingFace Hub across all speech tasks
  • Modular Brain class: compose any pipeline from reusable blocks
  • State-of-the-art ASR with Transformer, Conformer, and hybrid CTC/attention
  • Speaker verification and identification (ECAPA-TDNN, x-vectors)
  • Speech enhancement: MetricGAN+, SEGAN, and ConvTasNet separation

Quick Start

pip install speechbrain
import speechbrain as sb
from speechbrain.inference.ASR import EncoderDecoderASR

asr_model = EncoderDecoderASR.from_hparams(
    source="speechbrain/asr-conformer-transformerlm-librispeech",
    savedir="pretrained_models/asr-transformer-transformerlm-librispeech",
)
result = asr_model.transcribe_file("audio.wav")
print(result)
npx ai-supply add speechbrain-audio-toolkit

Curated mirror of the open-source SpeechBrain (Apache-2.0). Get it from the source.

Rating rank
#1
of 6 in Audio & Speech
Install rank
#3
of 6 in Audio & Speech
Security score
75/100 · B
review
Security rank
#3
of 6 in Audio & Speech
Installs
76k
cat avg 109k
This listing vs category average
Installs
this
cat avg
Security (of 100)
this
cat avg
Adoption trend
See the Audio & Speech leaderboard →
! Security: Review · 7575/100 · grade Bscanned 16d ago
✓ no compromise signals37 risk-surface · 7/20 OWASP controls flagged

Compromise signals — malicious or tampered code (leaked secrets, backdoors, a dropped executable) — reduce the score, and known dependency CVEs carry a bounded penalty (they warrant review but never QUARANTINE — update the dependency to clear). Other dangerous-by-capability traits are risk surface, expected for some capabilities. Every finding is mapped to its OWASP control below.

What this capability can do · med confidence (static)
⚑ filesystem⚑ shell⚑ network⚑ secrets
egress → colab.research.google.com, speechbrain.readthedocs.io, download.pytorch.org, about.readthedocs.com, www.dropbox.com, huggingface.co, readme-typing-svg.demolab.com?font=fira+code&size=40&duration=7000&pause=1000&random=false&width=1200&height=100&lines=simplify+conversational+ai+development, git.io +32
43 steps⚑ uses secretscolab.research.google.comgithub.commarvinpinto/action-automatic-releases@v1.2.0actions/checkout@v2actions/setup-python@v2pre-commit/action@v3.0.1actions/cache@v4actions/setup-python@v5

Findings mapped to the OWASP Top 10 for LLM Applications (2025) and the OWASP Machine Learning Security Top 10. Expand any flagged control for the exact findings — compromise reduces the score; expected/risk-surface do not, except a known CVE, which carries a small bounded penalty (high/critical → Review).

OWASP Top 10 for LLM Applications
⚠LLM03Supply Chaincritical
Vulnerable/compromised dependencies, models or archives in the artifact.
•Dependency manifest — 14 pip requirements declared · speechbrain-speechbrain-e5cb1f6/docs/docs-requirements.txtrisk surface
•Non-registry dependency source — 1 requirement(s) from git/URL/editable · speechbrain-speechbrain-e5cb1f6/docs/docs-requirements.txt (CWE-829)risk surface
•Dependency manifest — 3 pip requirements declared · speechbrain-speechbrain-e5cb1f6/docs/readthedocs-requirements.txtrisk surface
•Dependency manifest — 4 pip requirements declared · speechbrain-speechbrain-e5cb1f6/lint-requirements.txtrisk surface
•Dependency manifest — 1 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/AMI/Diarization/extra_requirements.txtrisk surface
•Dependency manifest — 5 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/Aishell1Mix/extra_requirements.txtrisk surface
•Dependency manifest — 8 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/DNS/enhancement/extra_requirements.txtrisk surface
•Dependency manifest — 6 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/ESC50/classification/extra_requirements.txtrisk surface
•Dependency manifest — 2 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/Fisher-Callhome-Spanish/extra_requirements.txtrisk surface
•Dependency manifest — 29 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/Voicebank/enhance/SGMSE/extra_requirements.txtrisk surface
•Dependency manifest — 16 pip requirements declared · speechbrain-speechbrain-e5cb1f6/requirements.txtrisk surface
•Vulnerable dependencies — 608 known vulnerabilities in: pytest@7.4.0, pillow@9.5.0, scipy@1.9.3, gitpython@3.1.37, idna@3.9.0, protobuf@3.9.2, torch@1.8.1, tqdm@4.9.0 (CWE-1395)known CVE · -25 pts
⚠LLM05Improper Output Handlingmedium
Code that pipes model/user output into shell, eval, SQL or paths unsafely.
•Suspicious code patterns — dynamic code execution · speechbrain-speechbrain-e5cb1f6/docs/tutorials/advanced/federated-speech-model-training-via-speechbrain-and-flower.ipynb (CWE-95)risk surface
•Suspicious code patterns — dynamic code execution; pickle deserialization · speechbrain-speechbrain-e5cb1f6/recipes/AMI/Diarization/experiment.py (CWE-95)risk surface
•Suspicious code patterns — OS command execution · speechbrain-speechbrain-e5cb1f6/recipes/CoVoST/covost_prepare.py (CWE-78)risk surface
•Suspicious code patterns — pickle deserialization · speechbrain-speechbrain-e5cb1f6/recipes/Voicebank/dereverb/MetricGAN-U/train.py (CWE-502)risk surface
•Suspicious code patterns — unsafe yaml.load · speechbrain-speechbrain-e5cb1f6/speechbrain/utils/checkpoints.py (CWE-502)risk surface
•Suspicious code patterns — OS command execution; dynamic code execution · speechbrain-speechbrain-e5cb1f6/tests/utils/recipe_tests.py (CWE-78)risk surface
⚠LLM06Excessive Agencymedium
Over-broad tool/permission surface or unrestricted egress.
•External endpoints declared — 1 distinct host(s) · speechbrain-speechbrain-e5cb1f6/.github/ISSUE_TEMPLATE/bug_report.yamlrisk surface
•External endpoints declared — 2 distinct host(s) · speechbrain-speechbrain-e5cb1f6/.github/pull_request_template.mdrisk surface
•External endpoints declared — 3 distinct host(s) · speechbrain-speechbrain-e5cb1f6/CITATION.cffrisk surface
•External endpoints declared — 39 distinct host(s) · speechbrain-speechbrain-e5cb1f6/README.mdrisk surface
•External endpoints declared — 5 distinct host(s) · speechbrain-speechbrain-e5cb1f6/docs/conf.pyrisk surface
•External endpoints declared — 4 distinct host(s) · speechbrain-speechbrain-e5cb1f6/docs/contributing.mdrisk surface
•External endpoints declared — 6 distinct host(s) · speechbrain-speechbrain-e5cb1f6/docs/installation.mdrisk surface
•External endpoints declared — 7 distinct host(s) · speechbrain-speechbrain-e5cb1f6/docs/tutorials/advanced/data-loading-for-big-datasets-and-shared-filesystems.ipynbrisk surface
•External endpoints declared — 10 distinct host(s) · speechbrain-speechbrain-e5cb1f6/docs/tutorials/advanced/dynamic-batching.ipynbrisk surface
•External endpoints declared — 9 distinct host(s) · speechbrain-speechbrain-e5cb1f6/docs/tutorials/advanced/pre-trained-models-and-fine-tuning-with-huggingface.ipynbrisk surface
•External endpoints declared — 8 distinct host(s) · speechbrain-speechbrain-e5cb1f6/docs/tutorials/nn/conformer-streaming-asr.ipynbrisk surface
•Broad capability surface — 3 high-impact capability categories referenced — verify least-privilege · speechbrain-speechbrain-e5cb1f6/docs/tutorials/nn/using-wav2vec-2.0-hubert-wavlm-and-whisper-from-huggingface-with-speechbrain.ipynb (CWE-272)risk surface
⚠LLM07System Prompt Leakagemedium
Secrets, internal hosts or proprietary logic exposed in shipped prompts.
•Internal host / private infrastructure reference — shipped content references a private IP range or internal-only host · speechbrain-speechbrain-e5cb1f6/docs/tutorials/advanced/federated-speech-model-training-via-speechbrain-and-flower.ipynb (CWE-200)risk surface
⚠LLM10Unbounded Consumptionmedium
Unbounded loops/recursion causing DoS or runaway cost.
Enforced at runtime by the gateway (rate limits + spend caps + size caps); static check flags unbounded loops.
•Potentially unbounded loop — an infinite loop (while True / while(1) / for(;;)) may cause runaway consumption · speechbrain-speechbrain-e5cb1f6/recipes/DNS/noisyspeech_synthesizer/noisyspeech_synthesizer_singleprocess.py (CWE-835)risk surface
§LLM09MisinformationGovernance
Artifacts designed to produce false/deceptive output.
Detectable only by runtime behavioral evaluation; addressed via responsible-use attestation.
✓LLM01Prompt InjectionPassed
✓LLM02Sensitive Information DisclosurePassed
✓LLM04Data and Model PoisoningPassed
Backdoors/poisoning in training data or serialized models.
Behavioral poisoning needs model execution; static check covers unsafe serialization + dataset skew only.
✓LLM08Vector and Embedding WeaknessesPassed
PII or plaintext source leakage in embedding/vector exports.
Embedding inversion/poisoning is largely runtime; static check covers PII in vector exports.
OWASP Machine Learning Security Top 10
⚠ML06AI Supply Chaincritical
Compromised PyPI/npm packages, typosquats, unsafe serialized models.
•Dependency manifest — 14 pip requirements declared · speechbrain-speechbrain-e5cb1f6/docs/docs-requirements.txtrisk surface
•Non-registry dependency source — 1 requirement(s) from git/URL/editable · speechbrain-speechbrain-e5cb1f6/docs/docs-requirements.txt (CWE-829)risk surface
•Dependency manifest — 3 pip requirements declared · speechbrain-speechbrain-e5cb1f6/docs/readthedocs-requirements.txtrisk surface
•Dependency manifest — 4 pip requirements declared · speechbrain-speechbrain-e5cb1f6/lint-requirements.txtrisk surface
•Dependency manifest — 1 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/AMI/Diarization/extra_requirements.txtrisk surface
•Dependency manifest — 5 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/Aishell1Mix/extra_requirements.txtrisk surface
•Dependency manifest — 8 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/DNS/enhancement/extra_requirements.txtrisk surface
•Dependency manifest — 6 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/ESC50/classification/extra_requirements.txtrisk surface
•Dependency manifest — 2 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/Fisher-Callhome-Spanish/extra_requirements.txtrisk surface
•Dependency manifest — 29 pip requirements declared · speechbrain-speechbrain-e5cb1f6/recipes/Voicebank/enhance/SGMSE/extra_requirements.txtrisk surface
•Dependency manifest — 16 pip requirements declared · speechbrain-speechbrain-e5cb1f6/requirements.txtrisk surface
•Vulnerable dependencies — 608 known vulnerabilities in: pytest@7.4.0, pillow@9.5.0, scipy@1.9.3, gitpython@3.1.37, idna@3.9.0, protobuf@3.9.2, torch@1.8.1, tqdm@4.9.0 (CWE-1395)known CVE · -25 pts
⚠ML09Output Integritymedium
Middleware tampering with model outputs in transit.
Gateway enforces TLS + response integrity; static check flags output-rewriting code.
•Suspicious code patterns — dynamic code execution · speechbrain-speechbrain-e5cb1f6/docs/tutorials/advanced/federated-speech-model-training-via-speechbrain-and-flower.ipynb (CWE-95)risk surface
•Suspicious code patterns — dynamic code execution; pickle deserialization · speechbrain-speechbrain-e5cb1f6/recipes/AMI/Diarization/experiment.py (CWE-95)risk surface
•Suspicious code patterns — OS command execution · speechbrain-speechbrain-e5cb1f6/recipes/CoVoST/covost_prepare.py (CWE-78)risk surface
•Suspicious code patterns — pickle deserialization · speechbrain-speechbrain-e5cb1f6/recipes/Voicebank/dereverb/MetricGAN-U/train.py (CWE-502)risk surface
•Suspicious code patterns — unsafe yaml.load · speechbrain-speechbrain-e5cb1f6/speechbrain/utils/checkpoints.py (CWE-502)risk surface
•Suspicious code patterns — OS command execution; dynamic code execution · speechbrain-speechbrain-e5cb1f6/tests/utils/recipe_tests.py (CWE-78)risk surface
§ML01Input Manipulation (Adversarial)Governance
Models vulnerable to adversarial perturbations.
Requires runtime robustness evaluation; addressed via publisher robustness attestation.
§ML03Model InversionGovernance
Training data reconstructable from a model's outputs.
Runtime/evaluation property; addressed via model-card data-provenance + DP attestation.
§ML04Membership InferenceGovernance
Determining whether a record was in the training set.
Runtime/evaluation property; addressed via overfitting disclosure + DP attestation.
§ML08Model SkewingGovernance
Models trained on skewed data producing biased output.
Requires fairness evaluation; addressed via model-card bias/limitations disclosure.
✓ML02Data PoisoningPassed
Poisoned training datasets with triggers or anomalous distributions.
Static check covers trigger phrasing, PII and label skew; full poisoning detection is runtime.
✓ML05Model TheftPassed
Unlicensed re-distribution / license-incompatible derivatives.
Static check verifies license declaration; extraction throttling is runtime.
✓ML07Transfer Learning AttackPassed
Backdoored base models / LoRA adapters propagating to derivatives.
Backdoor detection needs behavioral probing; static check covers unsafe serialization + provenance.
✓ML10Model Poisoning (Weights)Passed
Tampered model weight files; integrity must be verifiable.
Static check enforces safe formats + records a content hash for downstream verification.
Other findings (23) · hygiene / uncategorized
•Unrecognized file type — '.gitignore' is not on the allowlist · speechbrain-speechbrain-e5cb1f6/.gitignorerisk surface
•Unrecognized file type — '.cff' is not on the allowlist · speechbrain-speechbrain-e5cb1f6/CITATION.cffrisk surface
•Suspicious network references — URL shortener (3 URLs) · speechbrain-speechbrain-e5cb1f6/CITATION.cffrisk surface
•Unrecognized file type — '.?' is not on the allowlist · speechbrain-speechbrain-e5cb1f6/LICENSErisk surface
•Suspicious network references — suspicious TLD (146 URLs) · speechbrain-speechbrain-e5cb1f6/README.mdrisk surface
•Suspicious network references — suspicious TLD (1 URLs) · speechbrain-speechbrain-e5cb1f6/docs/docs-requirements.txtrisk surface
•Suspicious network references — suspicious TLD (24 URLs) · speechbrain-speechbrain-e5cb1f6/docs/tutorials/nn/neural-network-adapters.ipynbrisk surface
•Suspicious network references — suspicious TLD (49 URLs) · speechbrain-speechbrain-e5cb1f6/docs/tutorials/tasks/speech-classification-from-scratch.ipynbrisk surface
•Unrecognized file type — '.ini' is not on the allowlist · speechbrain-speechbrain-e5cb1f6/pytest.inirisk surface
•Suspicious network references — suspicious TLD (3 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/Aishell1Mix/prepare_data.pyrisk surface
•Suspicious network references — suspicious TLD (4 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/AudioMNIST/audiomnist_prepare.pyrisk surface
•Suspicious network references — suspicious TLD (2 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/CommonLanguage/lang_id/hparams/train_ecapa_tdnn.yamlrisk surface
•Suspicious network references — suspicious TLD (7 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/DNS/dns_download.pyrisk surface
•Suspicious network references — suspicious TLD (5 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/LJSpeech/ljspeech_prepare.pyrisk surface
•Suspicious network references — suspicious TLD (16 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/LibriParty/generate_dataset/README.mdrisk surface
•Suspicious network references — suspicious TLD (9 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/LibriParty/generate_dataset/download_required_data.pyrisk surface
•Suspicious network references — suspicious TLD (6 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/VoxCeleb/SpeakerRec/hparams/train_ecapa_tdnn.yamlrisk surface
•Suspicious network references — suspicious TLD (14 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/VoxLingua107/lang_id/README.mdrisk surface
•Unrecognized file type — '.m' is not on the allowlist · speechbrain-speechbrain-e5cb1f6/recipes/WHAMandWHAMR/meta/activlev.mrisk surface
•Suspicious network references — suspicious TLD (23 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/WSJ0Mix/separation/README.mdrisk surface
•Suspicious network references — suspicious TLD (17 URLs) · speechbrain-speechbrain-e5cb1f6/recipes/ZaionEmotionDataset/README.mdrisk surface
•Unrecognized file type — '.rttm' is not on the allowlist · speechbrain-speechbrain-e5cb1f6/tests/samples/rttm/ref_rttm/ES2014c.rttmrisk surface
•Unrecognized file type — '.pl' is not on the allowlist · speechbrain-speechbrain-e5cb1f6/tools/der_eval/md-eval.plrisk surface
✔ verified source · pinned speechbrain-speechbrain-e5cb1f6
Check against a policy

The same gate an agent runs before installing (POST /api/v1/trust/speechbrain-audio-toolkit/check). Click a policy:

Consume SpeechBrain programmatically. Authenticate with an API key or session — see Authorize an agent.

# Agents: CHECK BEFORE YOU INSTALL (no auth) — score, grade, level, capability manifest
curl https://ai-supply.store/api/v1/trust/speechbrain-audio-toolkit

# Gate against your org policy (returns { pass, violations })
curl -X POST https://ai-supply.store/api/v1/trust/speechbrain-audio-toolkit/check \
  -H "Content-Type: application/json" \
  -d '{"minGrade":"B","denyPermissions":["shell"],"denyUnknownEgress":true}'

# CLI
npx ai-supply add speechbrain-audio-toolkit

# REST (install → download)
curl -X POST https://ai-supply.store/api/v1/listings/speechbrain-audio-toolkit/install \
  -H "Authorization: Bearer $AIM_KEY"

# MCP tool
install_listing({ "slug": "speechbrain-audio-toolkit" })
OpenAPI spec →
vlatest
! Security: Review · 751mo ago

Curated mirror — latest upstream source. See the repository for tagged releases.

Sign in and install this listing to leave a review.

More from @ai-supply

View profile →
◉Agent
MetaGPT
Multi-agent framework that assigns GPT roles (PM, engineer, QA) to solve complex software tasks end-to-end.
↓ 1.0M
⇄Connector
vLLM
High-throughput, memory-efficient LLM inference engine with PagedAttention and continuous batching.
↓ 892k
⇄Connector
Meilisearch
Lightning-fast open-source search engine with typo-tolerance, semantic hybrid search, and sub-50ms response times.
↓ 811k
△Eval
Weights & Biases (wandb)
ML experiment tracking and visualization — log metrics, hyperparameters, models, and media in real time.
↓ 784k
ai-supply.store

Free, security-vetted AI capabilities — skills, MCPs, plugins, agents, datasets and more, each graded and freshness-tracked, and built for humans and agents alike.

api · v3.1status · all green
Contact
support@ai-supply.storesecurity@ai-supply.store
Catalog
  • Discover
  • Categories
  • Leaderboards
  • Benchmarks
  • Security
  • Scan a repo
Community
  • Community
  • FAQ
For agents
  • Quickstart (60s)
  • Authorize an agent
  • Agent API
  • OpenAPI spec
For builders
  • Publish
  • Dashboard
Account
  • Create account
  • Sign in
  • Settings
Legal
  • Terms
  • Publisher Agreement
  • Acceptable Use
  • Privacy