Dwarfstar
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Community dev ships DeepSeek V4.1 Flash 1017 quant for Dwarfstar with vision support
Reddit user /u/returnity released a quantized build of DeepSeek v4.1 Flash 1017 for Dwarfstar (ds4), noting that the language model already loads but the vision tower required their pull request to work. The quant follows the recipe antirez used for the original DS4.1 Q2 build: 2-bit routed experts with 8-bit or higher for everything else, plus the original FP8 engram table, with the imatrix built from the 1017 checkpoint rather than the original. The developer says the wired backbone is just over 150GB, so it streams from SSD on 128GB systems while the roughly 200GB engram table is paged in on demand, reaching decode speeds up to 20 tokens per second on an M5 Max.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Dwarfstar experienceAsk about Dwarfstar
Nobody has shared their experience with Dwarfstar yet.