Arena更新对齐指数方法与模型排名
Arena更新了对齐指数的方法论,称新的失败检测信号扩大了覆盖范围,并提高判断可靠性。按新榜单,OpenAI模型占据前七名,Claude Fable 5.2以78.2分首次排名第八,Claude Opus 5.5则从第六降至第十七。Kimi K3.1 Pro排名第九,多数开放模型仍落后于闭源模型。
此次方法论更新显著改变了模型排名,显示更广泛的失败检测会直接影响对智能体在真实用户会话中行为的评估。
The Arena Alignment Index has been updated!
We've refined how our signals detect model failures, providing broader coverage and more reliable judgements. Based on the updated methodology: - @OpenAI continues to dominate, holding all seven top positions. - @Anthropic's latest release, Claude Fable 5.2, debuts at #8 with a score of 78.2. Claude Opus 5.5, which ranked #6 on the previous index, is now #17. - Kimi K3.1 Pro by @Kimi_Moonshot is the biggest upgrade over its predecessor (more info in thread). - Most open source models are trailing closed releases. The best open model - Kimi K3.1 Pro - occupies #9, and the second best, Mimo-V2.6-Flash, is #26 on the Index, followed by Hy4, Beam, Inkling, DeepSeek and GLM.
The Top-6 lab: - #1 @OpenAI GPT-6.2 Sol - #2 @AnthropicAI Claude Fable 5.2 - #3 @Kimi_Moonshot Kimi K3.1 Pro - #4 @GoogleDeepmind Gemini 4 Hydrogen - #5 @spacexai Grok 4.7 - #6 @AIatMeta Muse Ember
Alignment Index measures how agents behave in real user sessions across three dimensions: - Unauthorized Action: Doing what the user didn’t ask for or approve - Deceptive Completion: Saying work is done, checked or working when it isn't - False Attribution: Crediting the user with something they never said or did
More insights in the thread🧵

#Arena Alignment Index#OpenAI#GPT-6.2 Sol#Claude Fable 5.2#Claude Opus 5.5#Kimi K3.1 Pro#Gemini 4 Hydrogen#Grok 4.7#Muse Ember#Mimo-V2.6-Flash