创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Agent Arena比较前沿模型的成本与任务时长

AI 总结

Agent Arena称,过去14天内近3万个任务运行超过一小时,所用模型平均调用工具332次。运行一小时的每项任务中位成本分别为Gemini 4 Carbon的10.51美元、Claude Opus 5.5的21.13美元和GPT-6 Astra的31.08美元。五家实验室的顶级模型在任务时长上相差55分钟。Claude Opus 5.5在Agent Arena排名第一,但其每小时成本约为Gemini 4 Carbon的两倍。

深度见解

这些结果量化了长周期智能体任务中模型能力与运行成本之间的取舍。Agent Arena称,在此类长周期任务中选择合适模型最多可降低66%的成本。

Models by @GoogleDeepMind scale better on cost than their rivals.

Gemini 4 Carbon is the prime example. As tasks get more demanding, every rival gets more expensive relative to Carbon.

For a typical task, GPT-6 Astra by @OpenAI costs 3.4× as much, Claude Opus 5.5 by @AnthropicAI costs 3.9× as much, and GPT-6.1 Sol is the cheaper option at about half of Carbon’s cost (0.54×).

Across the 5% most expensive sessions, Carbon’s position improves against all three. Opus edges up to 4.2×, Astra’s cost roughly doubles relative to Carbon, and Sol’s discount shrinks.

This in turn can translate into meaningful savings across real-world tasks such as building an Android security app, one of many long-horizon tasks that our Agent Arena users delegate to their agents.

@arena: As tasks get more complex, @GoogleDeepMind and @XiaomiMiMo are the biggest winners in the Agent Arena. On cheaper tasks, @OpenAI and @AnthropicAI hold 10 of the 11 frontier spots. On the most expensive 5% of sessions, they hold just 7. The freed spots go to Google’s Gemini 4 Argon and Xiaomi’s MiMo-V2.6 Flash and Pro. These shifts matter as sessions costing $100 or more are not uncommon across real-world use cases coming from Agent Arena. Even within the last 2 weeks, more than 1,000 sessions crossed that boundary, and choosing a suboptimal model might have had a meaningful impact on that final bill. https://x.com/arena/status/2118035889175838853

#Agent Arena#Gemini 4 Carbon#Claude Opus 5.5#GPT-6 Astra#GPT-6.1 Sol#Muse Wonder Full#Kimi K3.1 Pro#Gemini 4 Argon#MiMo-V2.6 Flash#MiMo-V2.6 Pro#Google DeepMind#OpenAI

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。