Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

ComfyUI v0.45.0 Boosts Qwen3.x Token Generation

AI summary

Comfy says it rewrote ComfyUI’s local text-generation path for Qwen3.x, enabling token generation up to twice as fast without changing the models or output quality. It reports that Qwen3.5 9B rose from 106 to 219 tokens per second on an RTX 5090, while Qwen3.8 27B rose from 55 to 122 tokens per second for 1536×1536 image descriptions. The improvements are available in ComfyUI v0.45.0, but the performance figures have not been independently verified.

In-depth insight

Comfy Blog says the optimization also accelerates prompt enhancers included with recent image-generation models, making local LLM workflows faster on existing NVIDIA and AMD hardware.

ComfyUI runs a variety of large language models (LLMs) locally for enhancing prompts, writing stories, describing images, and even basic chatting. Recently, we rewrote the hot path of that text generation with a specific focus on the Qwen3.x family of LLMs. The result is that the same checkpoints on the same GPU can now generate tokens up to twice as fast, with no change to the model or the quality of what it writes. This also speeds up many of the prompt enhancers included with the recent state-of-the-art image generation models.

On a RTX 5090, Qwen3.5 9B went from 106 to 219 tokens per second and on a RTX 5080 it went from 91 to 129 tokens per second. Qwen3.8 27B describing a 1536×1536 image went from 55 to 122 on a RTX 5090.

Qwen3.8 27B W4A8 on the RTX 5090, describing a 1500×1500 image and writing a story: 137 tokens per second with mtp on auto.

This blog discusses some architectural and implementation details of LLM inference and the recent speedups. Everything covered here is available in ComfyUI v0.45.0. Just load a Qwen3.x checkpoint, leave the Text Generate node’s mtp option on auto, and go.

#ComfyUI#Qwen3.x#Qwen3.5 9B#Qwen3.8 27B#NVIDIA GeForce RTX 5090#NVIDIA GeForce RTX 5080

Original · 9 min readRead the original
Group chat

No comments yet. Start the conversation.