Reddit 分析比较 Gyro 与 EXL3 量化格式
一位 Reddit 作者的代码分析称，Gyro-S 和 Gyro-M 与 EXL3 同属 QTIP/Trellis 编码量化家族，但采用 15 位状态、128 权重块编码和显式查表码本。该作者未找到 Gyro 在解码速度、困惑度、KLD 或 top-1% 表现上优于 EXL3 的公开证据。两种格式之间的直接互操作尚未得到证明，Gyro 的量化配方目前也未开源。
该 Reddit 作者称，Gyro 正被加入多种推理引擎，尤其是 Strata。其独特格式、尚未得到证明的互操作性以及闭源配方，与推理生态的发展直接相关。
Recently this new quant has popped up called Gyro. It is gaining popularity because it's being inserted into many different engines, especially the recently popular Strata.
So i took a dive into the code to see the differences between Gyro and EXL3, to me it looks like simply a different flavor of EXL3 quantization, but it's not interoperable and the recipe to make it is closed source for now.
| Property | Gyro-S / Gyro-M | EXL3 |
|---|---|---|
| Quantization family | QTIP / Trellis-coded quantization | QTIP / Trellis-coded quantization |
| Hadamard rotations | Yes | Yes |
| Trellis state size | 15 bits | 16 bits |
| Encoding unit | 128-weight blocks | 256-weight tiles (standard path) |
| Codebook | Explicit LUT with 2,048 2D points | Procedural codebook |
| Weight reconstruction | State hashing + lookup table | Procedural value generation |
| Bit packing format | TQ2_T, TQK6, TQK7 | EXL3-specific packing |
| Direct interoperability | Not demonstrated | Not demonstrated |
I did not find any published evidence that it's better than EXL3 on either decode speed, or perplexity/KLD/top 1%.
I'm not dunking on Agentionai but I kinda hate how this only makes the community more fragmented without providing any benefit. EXL3 is not very publicized while this Gyro is gaining popularity with aggressive brading (socials and stuff).
"Agention Precision Rotor"... please, proof....
submitted by /u/nasone32 [link] [comments]