PQ2_0
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- ik_llama.cpp adds native PQ2_0 support for Ternary Bonsai 2
A community guide reports that ik_llama.cpp now provides native CPU and CUDA support for PrismML’s Ternary Bonsai 2 in PQ2_0 format. It cites merged CUDA kernels, a lossless repacking script for upstream TQ2_0 and TQ1_0 weights, and runtime repacking with `-rtr 1` for faster CPU prompt processing; no independent benchmarks are provided.
r/LocalLLaMA · 🔥 4
Experience and discussion from the community
Share my PQ2_0 experienceAsk about PQ2_0
Nobody has shared their experience with PQ2_0 yet.