ComfyUI v0.45.0加速Qwen3.x生成
Comfy称已针对Qwen3.x重写ComfyUI的本地文本生成路径,在不改变模型和输出质量的情况下,令令牌生成速度最高提升至两倍。其数据显示,RTX 5090上的Qwen3.5 9B从每秒106个令牌升至219个,而Qwen3.8 27B在描述1536×1536图像时从55个升至122个。这些改进已随ComfyUI v0.45.0推出,但相关性能数据尚未获得独立验证。
Comfy Blog称,该优化还能加速近期图像生成模型附带的提示词增强器,使现有NVIDIA和AMD硬件上的本地大语言模型工作流运行更快。
ComfyUI runs a variety of large language models (LLMs) locally for enhancing prompts, writing stories, describing images, and even basic chatting. Recently, we rewrote the hot path of that text generation with a specific focus on the Qwen3.x family of LLMs. The result is that the same checkpoints on the same GPU can now generate tokens up to twice as fast, with no change to the model or the quality of what it writes. This also speeds up many of the prompt enhancers included with the recent state-of-the-art image generation models.
On a RTX 5090, Qwen3.5 9B went from 106 to 219 tokens per second and on a RTX 5080 it went from 91 to 129 tokens per second. Qwen3.8 27B describing a 1536×1536 image went from 55 to 122 on a RTX 5090.
Qwen3.8 27B W4A8 on the RTX 5090, describing a 1500×1500 image and writing a story: 137 tokens per second with mtp on auto.
This blog discusses some architectural and implementation details of LLM inference and the recent speedups. Everything covered here is available in ComfyUI v0.45.0. Just load a Qwen3.x checkpoint, leave the Text Generate node’s mtp option on auto, and go.
#ComfyUI#Qwen3.x#Qwen3.5 9B#Qwen3.8 27B#NVIDIA GeForce RTX 5090#NVIDIA GeForce RTX 5080