Radiance

Headlines · 1

1. 2d
   4x Radeon R9700 runs Qwen3.8 Flash-Next at ~190 tok/s, 6,800 tok/s prefill

   A Reddit user (/u/Anarchaotic) posted initial benchmarks for a four-GPU Radeon R9700 system (3x Gigabyte, 1x XFX, all power-limited to 210W) running Radiance v1.17.0 with a qwen3.8-next-flash-fp8-iq4r-moe.rad MoE model on Ubuntu 26.04.1 and ROCm 10.1. Client-side measurements show one user writing at about 190 tok/s, aggregate prefill of about 6,800 tok/s regardless of user count, and agent follow-up turns returning the first token in 0.2-2.5 s at 80-225 tok/s per user with 94-99% prefix-cache hits. The reported worst case of eight simultaneous fresh 128K prompts took about 151 seconds for the first token, while the two middle cards reached 91 C hotspot and 92 C memory during prefill.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my Radiance experienceAsk about Radiance