Arena revises Alignment Index methodology and model rankings
Arena updated the Alignment Index methodology, saying its revised failure signals provide broader coverage and more reliable judgments. Under the new rankings, OpenAI models hold all seven top positions, Claude Fable 5.2 debuts eighth with a score of 78.2, and Claude Opus 5.5 falls from sixth to seventeenth. Kimi K3.1 Pro ranks ninth, while most open-source models trail closed releases.
The methodology change materially altered model rankings and highlights how broader failure detection can affect evaluations of agent behavior in real user sessions.
The Arena Alignment Index has been updated!
We've refined how our signals detect model failures, providing broader coverage and more reliable judgements. Based on the updated methodology: - @OpenAI continues to dominate, holding all seven top positions. - @Anthropic's latest release, Claude Fable 5.2, debuts at #8 with a score of 78.2. Claude Opus 5.5, which ranked #6 on the previous index, is now #17. - Kimi K3.1 Pro by @Kimi_Moonshot is the biggest upgrade over its predecessor (more info in thread). - Most open source models are trailing closed releases. The best open model - Kimi K3.1 Pro - occupies #9, and the second best, Mimo-V2.6-Flash, is #26 on the Index, followed by Hy4, Beam, Inkling, DeepSeek and GLM.
The Top-6 lab: - #1 @OpenAI GPT-6.2 Sol - #2 @AnthropicAI Claude Fable 5.2 - #3 @Kimi_Moonshot Kimi K3.1 Pro - #4 @GoogleDeepmind Gemini 4 Hydrogen - #5 @spacexai Grok 4.7 - #6 @AIatMeta Muse Ember
Alignment Index measures how agents behave in real user sessions across three dimensions: - Unauthorized Action: Doing what the user didn’t ask for or approve - Deceptive Completion: Saying work is done, checked or working when it isn't - False Attribution: Crediting the user with something they never said or did
More insights in the thread🧵

#Arena Alignment Index#OpenAI#GPT-6.2 Sol#Claude Fable 5.2#Claude Opus 5.5#Kimi K3.1 Pro#Gemini 4 Hydrogen#Grok 4.7#Muse Ember#Mimo-V2.6-Flash