llama.cpp v0.8.0
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Community tester: DFlash2 for Qwen3.8-Flash-Next gives +17% decode speed in llama.cpp v0.8.0
A Reddit tester in r/LocalLLaMA reports that llama.cpp v0.8.0 is the first release supporting DFlash2 drafters for Qwen3.8-Flash-Next, after quantizing their own GGUFs of the drafter. Testing on an Apple M5 Max with Q4_K_XL showed a geometric mean of 87.9 tps for DFlash2 versus 75.1 tps for MTP, a 17% gain, with code prompts at 95.1 tps (+18%) and list prompts at 127 tps (+39%) but prose slightly lower at 51.9 tps (-3%). At around 25K context DFlash2 roughly equalled MTP with some drop-off, and the tester noted its Q4_0 draft head is only about 350MB versus 2.2GB for the ggml MTP head, though the required compute buffer offsets the VRAM savings.
r/LocalLLaMA · 🔥 2
Experience and discussion from the community
Share my llama.cpp v0.8.0 experienceAsk about llama.cpp v0.8.0
Nobody has shared their experience with llama.cpp v0.8.0 yet.