vLLM Ascend
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 2
- vLLM Ascend v0.30.0 released
The vLLM Ascend project announced v0.30.0 as the latest stable version of its community-maintained hardware plugin for running vLLM on Huawei Ascend NPUs. The project directs users to its official guide and lists prerequisites including Linux, Python 3.12, CANN 9.2.1, PyTorch 2.10.0, TorchNPU 2.10.0.post7, and a matching vLLM version.
GitHub Trending · Python · 🔥 0 - Huawei Ascend adds day-zero inference support for Kimi K3.1 Pro
Huawei announced that Ascend completed same-day inference adaptation for Kimi K3.1 Pro through vLLM Ascend and SGLang, according to IT之家 citing the Huawei Computing account. The vendor says deployment is supported on Ascend Atlas 800 A3, Atlas 900 A3 SuperPod, and Ascend 950 supernodes, with optimizations for sparse attention, million-token context, and multimodal inference. The 2.8-trillion-parameter model was released with full weights on November 4, 2026.
IT之家 AI · 🔥 0
Experience and discussion from the community
Share my vLLM Ascend experienceAsk about vLLM Ascend
Nobody has shared their experience with vLLM Ascend yet.