AMD RTX 9070 XT
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Qwen 3.6 MoE offloading hits 2,606 t/s prefill on RTX 9070 XT
Reddit user /u/willeyh reported running Qwen 3.6 35B-A3B in Q4 on an RTX 9070 XT 16GB, with offloaded experts placed in DDR4-3200 RAM. Increasing the chunk size to 5120 reportedly pushed prefill above 2,000 t/s at all tested context lengths and peaked at 2,606 t/s at 32K, while larger chunks produced no further gains. ExLlamaV3's cpu_threads 6 setting slightly improved decoding, but several other flags regressed and cpu_moe_pinned_arena caused core dumps.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my AMD RTX 9070 XT experienceAsk about AMD RTX 9070 XT
Nobody has shared their experience with AMD RTX 9070 XT yet.