Pure C/C++ LLM inference library — run quantized models on CPU, Metal, CUDA and more.

The Natural Language Toolkit — Python's foundational NLP library for tokenization, POS tagging, parsing, and corpora.

State-of-the-art sentence and text embeddings — compute semantic similarity, clustering, and dense retrieval.

Fast, memory-mapped dataset library for NLP and ML — 50,000+ datasets, streaming, and Arrow-backed processing.

Run powerful open-source LLMs locally — privacy-first desktop app and Python SDK, no internet required.

Ultra-fast tokenizer library (Rust core) — BPE, WordPiece, SentencePiece — tokenize GBs in seconds.

Industrial-strength NLP library for Python with pre-trained pipelines for tokenization, NER, parsing, and more.

Run PyTorch training scripts on any hardware — single GPU, multi-GPU, TPU — with minimal code changes.

Microsoft's deep learning optimization library — train trillion-parameter models with ZeRO memory parallelism.

8-bit and 4-bit quantization for PyTorch — run and fine-tune LLMs on consumer GPUs with minimal quality loss.

Fine-tune LLMs with RLHF, PPO, DPO, SFT, and GRPO — the standard library for aligning language models.

Unified fine-tuning framework for 100+ LLMs — SFT, RLHF, DPO, LoRA, QLoRA via Web UI or CLI.

Apache-licensed 7B language model from Mistral AI — beats Llama 2 13B on most benchmarks at half the size.

Hugging Face Transformers: state-of-the-art pre-trained models for NLP, vision, audio, and multimodal tasks.

Facebook AI's library for efficient text classification and word representation learning — trains in seconds on millions of documents.

The largest open prompt collection — thousands of curated system prompts for personas, coding, writing, education, and creative tasks. CC0 licensed.

MIT-licensed SOTA English embedding model from BAAI — top MTEB leaderboard performer, commercial-friendly.

Microsoft's MIT-licensed 3.8B SLM — instruction-tuned, runs on CPU/mobile, punches far above its weight class.

384-dimensional sentence embeddings with tens of millions of downloads — fast, compact, and remarkably accurate for semantic search and clustering.

MIT-licensed comprehensive guide and prompt library — techniques, examples, and templates for every major LLM prompting method.

Modular topic modeling framework using transformer embeddings and c-TF-IDF for interpretable, coherent topics.

Alibaba's Apache-2.0 7B instruction model — top multilingual performance, 128k context, strong at coding and math.

Apache-2.0 text embedding model with 8192-token context — the first open, auditable, long-context embedding.

Simple NLP library with SOTA models for NER, POS tagging, chunking, text classification, and contextual string embeddings.