ds4

Headlines · 1

1. Oct 18
   Community dev ships DeepSeek V4.1 Flash 1017 quant for Dwarfstar with vision support

   Reddit user /u/returnity released a quantized build of DeepSeek v4.1 Flash 1017 for Dwarfstar (ds4), noting that the language model already loads but the vision tower required their pull request to work. The quant follows the recipe antirez used for the original DS4.1 Q2 build: 2-bit routed experts with 8-bit or higher for everything else, plus the original FP8 engram table, with the imatrix built from the 1017 checkpoint rather than the original. The developer says the wired backbone is just over 150GB, so it streams from SSD on 128GB systems while the roughly 200GB engram table is paged in on demand, reaching decode speeds up to 20 tokens per second on an M5 Max.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my ds4 experienceAsk about ds4