Artificial Analysis将开放CritPt v2评分服务
Artificial Analysis表示，已与CritPt作者完成CritPt v2评分服务器，并计划于次日通过API向社区开放。作者提升了评分服务器逻辑的稳健性，Artificial Analysis将这些改动纳入Intelligence Index 5.0.1。重新评分为全部模型后，多数模型得分小幅上升，但前沿模型排名未变，分数变动不超过1分。
此次更新将开放CritPt v2评分方法，同时表明稳健性修复对前沿模型排名影响很小。
We’ve worked with the CritPt authors to finalize the CritPt v2 grading server and will be making this available to the community via Artificial Analysis’ API tomorrow. As part of this process the authors made robustness improvements to the grading server logic, which we have incorporated as v5.0.1 of the Artificial Analysis Intelligence Index
We regraded every model and observe small score increases for most models. Intelligence Index rankings are unchanged among frontier models, with scores moving by at most 1 point.
Thanks to @MiniHui_zhu, @MinyangTian1 and the rest of the CritPt team for their ongoing collaboration
#Artificial Analysis#CritPt v2#Artificial Analysis Intelligence Index