dsx

Headlines · 1

1. Oct 19
   DeepSeek V4.1 Flash 2.61-bit quant runs at 26 t/s on dual RTX 3090s

   Reddit user whiteh4cker (r/LocalLLaMA) says they built DeepSeek-V4.1-Flash-1017-dsx-2.6bit, a 2.6-bit quantization made with lxe's dsx engine for programming and agentic tasks, and that the full weights would be uploaded within two hours of the post. The post self-reports that the 2.6127 bpw build scored 82.59% top-1 and 9.3626 perplexity against the FP8/FP4 teacher model, and reached 26 t/s generation and 170 t/s prompt processing at 262,144 context with Engram tables on two RTX 3090s with 192 GB DDR5. The author also notes the engine does not yet support images and that loading the 187.6 GB weight from an HDD takes 90–110 minutes.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my dsx experienceAsk about dsx