Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Zaggita GPU unlock boosts prefill on Chinese RTX 3080 20GB

AI summary

A Reddit user reports that Zaggita’s GPU performance unlock works on Chinese RTX 3080 20GB cards. In the poster’s vLLM test on two GPUs, prefill throughput rose about 20.8%–28.6% while decode steps per second showed no apparent change; the characterization of the unlock as removing an NVIDIA AI-compute restriction was not independently confirmed.

In-depth insight

The reported results indicate a substantial prompt-processing gain for local LLM inference on an otherwise limited consumer-GPU configuration, although the evidence comes from one user’s test.

Just ran my own tests of the new GPU performance unlock by Zaggita. If you missed it: Nvidia locked down compute speed on consumer cards for some specific hardware instructions needed for AI; the unlock fixes it. TLDR: got +20% prefill impovement, 0% decode change after unlock.

Details:

Test bench: my two old 2x RTX3080 20GB, this time paired with Threadripper 1920x, both running PCIe 3.0 x16. Both GPUs power limited to 240W.

System: Proxmox 9.2.3, linux kernel 6.14.11-9-pve, proprietary Nvidia drivers 610.57.04, CUDA 13.3.

Inference: vLLM 0.32.0 running inside Debian 13 LXC container, tensor parallel mode.

Model: cyankiwi/Swift-1.5-Qwen3.8-27B-AWQ-INT4, fp8 kv cache, MTP enabled.

#Zaggita#NVIDIA GeForce RTX 3080 20GB#vLLM#Qwen3.8#Threadripper 1920X#FlashInfer

Original · 2 min readRead the original
Group chat

No comments yet. Start the conversation.