Qwen3.8 Flash Next 量化表现接近BF16
AI 总结
一名 Reddit 用户称,Unsloth 的基准图表显示 Qwen3.8 Flash Next 的 IQ_3S GSQ RCO 量化在12项基准上的得分为 BF16 基线的99.0%。报告还引用了 Unsloth 的说法,称 UD v3.1 量化在文件大小大致相近时比 GSQ RCO 高约15%,但该比较属于厂商主张,原始图表也未获独立核实。
深度见解
这项对比为本地部署 Qwen 的用户在 IQ_3S GSQ RCO 与 UD v3.1 量化权重之间选择提供了基准依据。
| Unsloth has posted about their UD v3.1 quant for Qwen3.8 FN on X saying their new quant is 15% better than GSQ RCO as the almost same file size. But the takeaway from the post for me and many other how are using IQ_3S GSQ RCO with Strata is that it is 99.0% percent as good as the BF16 The chart of the top left with base line for BF16 is 100% and IQ_3S GSQ RCO scored 99.0% the score is average of 12 benchmarks, and Unsloth kindly has spent ~30b tokens to generate these results. This is reassuring that quant I am running locally is almost as good as the original, if you are in a similar situation this should put your mind at ease. If you are about/plan to download the weights the UD v3.1 quant seems, be about 15% better than IQ_3S GSQ RCO. X post link: https://x.com/UnslothAI/status/2118033433045991660 submitted by /u/DigiDecode_ [link] [comments] |