Guides
- User Guide7,699 words, about 33 min to read. Markdown
- Admin Guide8,563 words, about 37 min to read. Markdown
vllm-project/vllm
vLLM is a high-throughput, memory-efficient inference and serving engine for large language models.
Generated May 2026 from vllm-project/vllm at 58da4ee
AI-generated documentation. The library is checked by sampling (three repositories so far); this guide was not individually reviewed. Verify against the project before relying on it.
Source and caveats
Built from the public repository github.com/vllm-project/vllm at commit 58da4ee. Upstream may have moved on since.
Unofficial; not affiliated with or reviewed by the project. How the guides were made, and how they were checked: guide library.