ik_llama.cpp原生支持Ternary Bonsai 2
一篇社区指南称，ik_llama.cpp现已原生支持PrismML的Ternary Bonsai 2及PQ2_0格式，并覆盖CPU和CUDA。指南提到已合并CUDA内核、用于上游TQ2_0和TQ1_0权重的无损重打包脚本，以及通过`-rtr 1`加速CPU提示处理的运行时重打包，但没有提供独立基准测试。
据该指南，这一更新为Ternary Bonsai 2用户在PrismML自有分支之外使用PQ2_0 GPU卸载和CPU推理提供了原生路径。
Hey folks,
Quick heads up for anyone playing around with PrismML's Ternary Bonsai 2!
Until very recently, running it outside of Prism's own fork was a bit of a pain. Upstream llama.cpp uses a block size of QK=256 (TQ2_0), while Prism uses QK=128 (PQ2_0), and trying to offload layers to CUDA on other forks would bottleneck or break due to Hadamard sign tensor handling.
With the latest commits landed in ik_llama.cpp, we finally have complete, native support across both CUDA and CPU. Here is how to set it up cleanly.
- Convert upstream weights losslessly (PR #2694)
If you already have a native PQ2_0 GGUF downloaded from Prism, you can skip this.
#Ternary Bonsai 2#ik_llama.cpp#PrismML#llama.cpp#PQ2_0#TQ2_0#TQ1_0#NVIDIA CUDA