Bonsai 2 Ternary 4B
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- LookAtMyQuant 2 Compresses Qwen and Inkling Models
LookAtMyQuant 2 is an open-source quantization compiler that measures how compression affects a model’s output and assigns codes and bit budgets to stored model components. Its recipe uses post-training quantization, trellis codes, Fisher information for per-row bit allocation, and distillation. The project released a 1.23 GB Qwen3.5-4B artifact and reports compressing Inkling-2-Mini from 18.89 GB of text weights to 5.38 GB and 8.87 GB. The method and MIT-licensed code are available through the project site. The project claims its Gemma 4 E2B GGUF has 12× lower KL divergence than Q4_K_M at the same file size, but the supplied report contains no independent corroboration.
Hacker News 首页(100+ 分) · 🔥 26
Experience and discussion from the community
Share my Bonsai 2 Ternary 4B experienceAsk about Bonsai 2 Ternary 4B
Nobody has shared their experience with Bonsai 2 Ternary 4B yet.