Radeon RX 7900 XTX
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 2
- Reddit user reports LFM3-1.7B local inference results
A Reddit user testing Liquid's LFM3-1.7B in Q8_0 GGUF with llama.cpp and ROCm reported 4.1k tokens per second prefill and about 78 tokens per second decode on a Strix Halo iGPU. The user also reported roughly 7.1k prefill and 151 decode tokens per second when tensor-splitting the model across a Radeon RX 7900 XTX and an unspecified “XT” device. They described LFM3-1.7B as much more coherent at 32k–64k-token prompt sizes than a 1.7B model.
r/LocalLLaMA · 🔥 0 - Deepseek V4.1-1017 runs on RDNA GPUs with variable local throughput
A Reddit user tested Deepseek V4.1-1017 on an AMD Ryzen 3950X system with 96GB of DDR4 memory, a Radeon RX 7900 XTX, a Radeon Pro W6800, and a PCIe Gen 3 NVMe drive. Using mostly IQ2 weights with Q6 n-grams, the roughly 350GB model reached peaks of 19 tokens per second, usually produced about 13 tokens per second, and sometimes fell to 3; prefill was approximately 150 tokens per second. The tester attributed the large variation primarily to I/O needs rather than dspark hits and reported average decode speed of 9 tokens per second at the end of a long prompt.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Radeon RX 7900 XTX experienceAsk about Radeon RX 7900 XTX
Nobody has shared their experience with Radeon RX 7900 XTX yet.