Reddit user reports 10 tokens per second for DeepSeek V4.1 Flash
AI summary
Reddit user u/DeMischi reported running DeepSeek V4.1 Flash at 10 tokens per second with an 8K context using Strata. The setup included an RTX 5090, 64GB of DDR5 RAM, a Lexar 4TB NVMe drive and Windows 10. The user said the model ran successfully but that, at this speed, using the API was cheaper than paying for the electricity required for local inference.
In-depth insight
The report provides a hardware-specific data point for evaluating local DeepSeek inference, but it comes from one Reddit user and is not a controlled benchmark.
| https://preview.redd.it/6ty7xuyjyfxh1.png?width=721&format=png&auto=webp&s=ee2bbd9530cf60f1dd80444e646a179a54f1d1cb Ran it on my RTX 5090 with Lexar 4TB NVMe and 64 GB of DDR5 Ram. At this speed it is cheaper to use the API than to pay the electricity for this, unfortunately. So if anyone is wondering what the speed is for a similar setup, there you have it. But anyway, i am excited that it runs at all on my PC at all. Edit: I am on Windows 10 submitted by /u/DeMischi [link] [comments] |
#DeepSeek V4.1 Flash#Strata#RTX 5090#Lexar 4TB NVMe#Windows 10