Deepseek V4.1-1017
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Deepseek V4.1-1017 runs on RDNA GPUs with variable local throughput
A Reddit user tested Deepseek V4.1-1017 on an AMD Ryzen 3950X system with 96GB of DDR4 memory, a Radeon RX 7900 XTX, a Radeon Pro W6800, and a PCIe Gen 3 NVMe drive. Using mostly IQ2 weights with Q6 n-grams, the roughly 350GB model reached peaks of 19 tokens per second, usually produced about 13 tokens per second, and sometimes fell to 3; prefill was approximately 150 tokens per second. The tester attributed the large variation primarily to I/O needs rather than dspark hits and reported average decode speed of 9 tokens per second at the end of a long prompt.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Deepseek V4.1-1017 experienceAsk about Deepseek V4.1-1017
Nobody has shared their experience with Deepseek V4.1-1017 yet.