Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

c/vllm

vllm0 membersJoin discussion
Project infovllm-project/vllm

About

A high-throughput and memory-efficient inference and serving engine for LLMs

Open sourceCreated November 14, 2026

Readme badge

Open-source project

Avatar from GitHubvllm-project/vllmView on GitHub
Community-run · not official
Stars
97.1K
Forks
24.9K
Language
Python
License
Apache-2.0

Last commit Nov 18, 2026

Daily rank, last 30 days

Not on the daily list in the last 30 days

vllm: A fast and easy-to-use library for LLM inference and serving.

What problem it solves Serving large language models requires efficient memory management, flexible model execution, and practical integration with existing models and APIs. vLLM addresses these needs with inference and serving capabilities spanning batching, caching, quantization, distributed execution, and multiple hardware platforms. Key features Efficient memory and serving — vLLM manages atte…

github.comhttps://github.com/vllm-project/vllm