创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Arena推出Agent Arena Index及六个专项指数

AI 总结

Arena推出Agent Arena Index,作为衡量智能体综合表现的主榜,并发布Agentic Work、Coding、Chat、Task Outcomes、Tool Use和Steering六个专项指数。Arena称,这些指数基于其全球社区提交的数百万个真实任务和轨迹,综合用户确认的任务完成度、表扬与抱怨比例、Bash可靠性和可引导性等信号。初始Agent Arena Index榜单中,Claude Fable 5.2 (Max)以1,463分居首,Gemini 4 Carbon (High)以1,307分排名第二,GPT-6 Astra (Max)以1,274分排名第三。

深度见解

此次发布提供了Arena用于比较AI智能体在真实任务执行、工具使用、反馈适应和对齐方面表现的框架。Arena表示正在更新分数,以使其更稳定、更易理解;相关报道未提供对指数或排名的独立验证。

Today, we’re excited to introduce the Agent Arena Index, our new headline measure of overall agent performance, alongside six new focused indexes: Agentic Work, Coding, Chat, Task Outcomes, Tool Use, and Steering.

Together with the Alignment Index, these indexes provide a comprehensive view of how agents perform across real-world tasks, from completing complex workflows to using tools and adapting to user feedback.

Arena measures agentic performance from millions of real-world tasks by our global community. With the launch of the new indexes, we are updating our scores to provide a more stable and interpretable way to understand how agents perform in the real world.

Claude Fable 5.2 (Max) leads the Agent Arena Index by 134 points with a score of 1463. Top 5 labs on the Agent Arena Index:

- #1 @AnthropicAI: With Claude Fable 5.2 (Max) at 1463 pts - #2 @GoogleDeepMind: With Gemini 4 Carbon (High) at 1307 pts - #3 @OpenAI: With GPT-6 Astra (Max) at 1274 pts - #4 @AIatMeta: With Muse Wonder Full (Max) at 1200 pts - #5 @Alibaba_Qwen: With Qwen4-Max (xHigh) at 1191 pts

The Agent Arena Index combines four key signals of real-world agent performance: - Task Completion: explicit confirmation of task success from users - Praise vs. Complaint: user satisfaction with agent's outcome - Bash Reliability: how well an agent uses terminal tools - Steerability: how well an agent responds to user corrections

Alongside capability, the Alignment Index measures how faithfully agents act in accordance with user intent, based on three key signals: Deceptive Completion, Unauthorized Action, and False Attribution.

As agents take on increasingly complex, long-horizon work, measuring their real-world capabilities and alignment is more important than ever.

Explore the rankings and see what each index measures in the thread below.

@arena: https://x.com/i/article/2123122245950418945 https://x.com/arena/status/2123124648108064966

#Arena#Agent Arena Index#Claude Fable 5.2#Gemini 4 Carbon#GPT-6 Astra#Muse Wonder Full#Qwen4-Max

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。