KQuant
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Nace releases open-source KQuant MLX packages for Qwen models
Nace released free, open-source KQuant packages in standard MLX format for Qwen3.5-4B, Qwen3.5-9B, Qwen3.8-27B, Qwen3.6-35B-A3B, and Qwen3.8-Flash-Next. In the developers’ measurements, the packages had KL divergence from full-precision next-token predictions up to 3.7 times lower than cited public 4-bit baselines. On an M5 Pro, selected models were reported to write 6%–15% faster with Kapitsa 0.2.35 and the KFlash drafter, although baseline tests used earlier Kapitsa versions. The packages require no custom kernels or special loader. GGUF versions were still being tested ahead of a planned public release.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my KQuant experienceAsk about KQuant
Nobody has shared their experience with KQuant yet.