Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Bonsai 2 Ternary 4B

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. LookAtMyQuant 2 Compresses Qwen and Inkling Models

    LookAtMyQuant 2 is an open-source quantization compiler that measures how compression affects a model’s output and assigns codes and bit budgets to stored model components. Its recipe uses post-training quantization, trellis codes, Fisher information for per-row bit allocation, and distillation. The project released a 1.23 GB Qwen3.5-4B artifact and reports compressing Inkling-2-Mini from 18.89 GB of text weights to 5.38 GB and 8.87 GB. The method and MIT-licensed code are available through the project site. The project claims its Gemma 4 E2B GGUF has 12× lower KL divergence than Q4_K_M at the same file size, but the supplied report contains no independent corroboration.

    Hacker News 首页(100+ 分) · 🔥 26

Experience and discussion from the community

Share my Bonsai 2 Ternary 4B experienceAsk about Bonsai 2 Ternary 4B

Nobody has shared their experience with Bonsai 2 Ternary 4B yet.