MACaQ
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 3
- Author reports lower KL divergence for Hessian-refined Qwen3.8-27B GGUF
A Reddit user released a Hessian-refined Qwen3.8-27B UD_4_XL GGUF that applies the first two MACaQ refinement techniques without requiring inference-software patches. On a small test set using one RTX 5090, the author reports 13.23% lower KL divergence than the Unsloth version, equal inference speed, and a 4% LiveCodeBench improvement that the author describes as a single, unreliable data point. The third MACaQ technique was not used because it requires inference-software updates.
r/LocalLLaMA · 🔥 0 - Huawei CSL offers MACaQ-R GGUF for Qwen3.6-35B-A3B
A Hugging Face entry for huawei-csl/Qwen3.6-35B-A3B-MACaQ-R-GGUF was linked in an r/LocalLLaMA post. The post also directs readers to the MACaQ paper, GitHub project, and model collection, but provides no technical details or independent evaluation.
r/LocalLLaMA · 🔥 0 - Huawei releases open-source MACaQ quantization method
Huawei released MACaQ, an open-source quantization method that supports text, image, video and audio models across llama.cpp, vLLM, Diffusers, PyTorch and Ascend backends. The project says MACaQ can quantize a 122B-parameter model in 64 minutes with 32.5 GB of device memory, while its reported Qwen3 GGUF tests show lower mean KL divergence than Unsloth and Bartowski at similar file sizes. These performance claims come from the project and published results cited by a Reddit submitter, who said they had not independently tested the 122B-model result.
Hacker News 首页(100+ 分) · 🔥 0
Experience and discussion from the community
Share my MACaQ experienceAsk about MACaQ
Nobody has shared their experience with MACaQ yet.