创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Arena推出智能体编程指数

AI 总结

Arena推出Coding Index,用于根据真实编程任务评测智能体。Arena称,GPT-6.2 Astra (Max)在该指数获得1338分、排名第三,其Agent Arena Index总分为1291分、排名第六。Arena表示,前者在Coding Index上比GPT-6 Astra (Max)高50分,单任务中位成本低62%。

深度见解

该指数利用Arena的真实任务评测数据,更具体地呈现智能体的编程表现与成本差异。

Introducing Arena’s Coding Index: measuring which agents are best at real coding work.

For GPT-6.2 Astra (Max) by @OpenAI, coding is a strength. On the Coding Index specifically, it scored 1338 pts at #3!

Its overall Agent Arena Index score landed at 1291 pts at #6.

This Coding Index score of 1338 is +50 pts over its previous variant, GPT-6 Astra (Max), at 62% lower median cost per task ($4.75 vs. $12.55), earning a spot on the cost Pareto frontier for the Coding Index (see placement in thread).

Congrats to the @OpenAI team!

@arena: Scores for GPT-6.2 Astra and Sol are on the NEW Agent Arena Index! - #6 with 1291 pts: GPT-6.2 Astra (Max), now @OpenAI’s best model - #11 with 1241 pts: GPT-6.2 Sol (Max), joining the cost Pareto frontier The Agent Arena Index is our new headline measure of overall agent performance, built from millions of real-world tasks and traces from our global community. Results for GPT-6.2 Astra and Sol are based on 7.1K+ real agentic sessions. GPT-6.2 Astra: #6 with 1291 pts - +9 pts vs previous variant GPT-6 Astra (Max), currently #7 - Median cost per task: $2.94 vs. $4.91 for GPT-6 Astra, 40% lower - Strongest signal: #5 with 1462 pts in Praise vs Complaint (user satisfaction with agent's outcome) GPT-6.2 Sol: #11 with 1241 pts - Matches #12 GPT-6.1 Sol (Max) with 1241 pts, at a 13% lower median cost per task ($0.90 vs. $1.04) - Joins the Pareto frontier (see placement in thread) 6.2 Astra vs. Sol - Astra scores +50 pts above Sol at #6 vs #11 - Sol’s median cost per task is 69% lower ($0.90 vs. $2.94) Congrats to the team at @OpenAI on this release! https://x.com/arena/status/2123234410032214464

#Arena#OpenAI#GPT-6.2 Astra#GPT-6.2 Sol#Agent Arena Index

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。