Radeon Pro W6800

Headlines · 1

1. Oct 23
   Deepseek V4.1-1017 runs on RDNA GPUs with variable local throughput

   A Reddit user tested Deepseek V4.1-1017 on an AMD Ryzen 3950X system with 96GB of DDR4 memory, a Radeon RX 7900 XTX, a Radeon Pro W6800, and a PCIe Gen 3 NVMe drive. Using mostly IQ2 weights with Q6 n-grams, the roughly 350GB model reached peaks of 19 tokens per second, usually produced about 13 tokens per second, and sometimes fell to 3; prefill was approximately 150 tokens per second. The tester attributed the large variation primarily to I/O needs rather than dspark hits and reported average decode speed of 9 tokens per second at the end of a long prompt.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my Radeon Pro W6800 experienceAsk about Radeon Pro W6800