HyperQwen
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Sparse-KV extension runs eight 250K-context coding agents on two RTX 3090s
A Reddit author reports a sparse-attention extension for HyperQwen that keeps full int4 KV caches in system RAM while retrieving roughly 1% of tokens through a rank-64 key sketch. On a 3090 Ti and 3090, the author measured eight concurrent Qwen3.8-27B-W4A16 coding agents with 250K-token contexts at about 545 tokens per second on explain-style output, 31/32 recall, and roughly five-second follow-up starts. The author also reports that approximate attention can occasionally confuse near-duplicate code lines.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my HyperQwen experienceAsk about HyperQwen
Nobody has shared their experience with HyperQwen yet.