SubQ Snap 1.2 在 Decision Index v2.1 上提升五分
Artificial Analysis 报告称,SubQ Snap 1.2 在 Decision Index v2.1 上得分 73,SubQ Snap 1.1 的得分为 68。Drex Max v1.1 和 GLiDE v1.2 也均列为 73 分,但报告指出三者相差不足 0.1 分,因此无法确认完全并列。报告称,价格维持在每百万输入 token 0.04 美元,该模型支持 384K token 上下文窗口。
此次更新在 AA-Paperclip 和 AA-Symmetry 上的增幅最大,均提高八分。Paperclip 的全通过率从 46% 升至 62%;AA-Omniscience-Decision 和 HLE-MultiChoice 的增益则来自更高的弃答率,而非准确率提高。
Subquadratic’s SubQ Snap 1.2 gains 5 points over SubQ Snap 1.1 on the Artificial Analysis Decision Index v2.1, and is tied with Drex Max v1.1 and GLiDE v1.2 as the leading decision model
SubQ Snap 1.2 is the latest decision model from @subquadratic. Pricing is unchanged at $0.04 per 1M input tokens, and it supports a 384K token context window.
Decision Index v2.1 updates AA-Symmetry to v1.1. AA-Symmetry measures whether a model keeps the same decision and confidence when a question changes in ways that should not matter. v1.1 moves the answer options into the state and rewords them with the same meaning.
Key takeaways:
➤ SubQ Snap 1.2 scores 73 on the Artificial Analysis Decision Index v2.1, up from 68 for SubQ Snap 1.1: Drex Max v1.1 (73) and GLiDE v1.2 (73) are within 0.1 points. The largest gains are on AA-Paperclip (+8 points) and AA-Symmetry (+8 points).
➤ The AA-Paperclip gain comes from more documents answered fully correctly: the all-pass rate rises from 46% to 62%, level with Drex Max v1.1 (63%) and GLiDE v1.2 (62%).
➤ The gains on AA-Omniscience-Decision and HLE-MultiChoice come from abstention, not accuracy: non-hallucination rates rise from 85% to 89% and from 46% to 55%. Accuracy is flat at 21% and 9%. On AA-Omniscience-Decision, SubQ Snap 1.2 attempts 29% of questions, down from 33%.

#Subquadratic#SubQ Snap 1.2#SubQ Snap 1.1#Drex Max v1.1#GLiDE v1.2