创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Artificial Analysis 重构智能指数

AI 总结

Artificial Analysis 发布 Intelligence Index v5,60%的评测改用私有测试集或隐藏答案。新版加入 FrontierCode 2.0 和 Terminal-Bench-Science,升级三项既有评测,并推出 Progress Index v1;Claude Opus 5.5 以58分位居首。

深度见解

此次重构将模型排名转向更真实的编程与科学任务,但也使综合成绩无法被外界完整独立复现。

RT Artificial Analysis Announcing Artificial Analysis Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 is our biggest upgrade since v4 launched in January. With v5, 60% of the Index is now based on evaluations with private test sets or held-out answers. Alongside Intelligence Index v5, we’re launching the Artificial Analysis Progress Index v1, which tracks model capability over time on one continuous scale. New to the Intelligence Index: ➤ FrontierCode 2.0: Cognition's newly-launched private benchmark of real-world coding tasks, graded on whether a repository maintainer would merge the agent's change ➤ Terminal-Bench-Science: 70 agentic scientific research tasks, run in a terminal environment Upgraded: ➤ HLE-Diamond (replacing Humanity's Last Exam): a refined 1,000-question version of Humanity's Last Exam, split evenly between reasoning and knowledge questions ➤ AA-Omniscience v1.1: An updated dataset with saturated and public set questions removed, new questions added, and ambiguous or erroneous questions revised ➤ CritPt v2: a private, 40-question hard subset of CritPt v2, revised by the CritPt authors and run with a code-execution tool Staying in the Index: AA-Briefcase, AutomationBench-AA, GDP.pdf and Terminal-Bench 4.0 Removed from the Index: GDPval-AA v2.1, SciCode, and AA-LCR v1.1 Key results: ➤ Claude Opus 5.5 (max) leads at 58, ahead of GPT-6 Astra (max, 57) and GPT-6.1 Sol (max, 55): Anthropic and OpenAI hold the top five models.

#Artificial Analysis#Artificial Analysis Intelligence Index v5#Artificial Analysis Progress Index v1#FrontierCode 2.0#Terminal-Bench-Science#Cognition#Claude Opus 5.5#GPT-6 Astra#GPT-6.1 Sol#Kimi K3.1 Pro#DeepSeek V4.1 Flash 1017#GLM-5.3

原文约 2 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。