创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Artificial Analysis推出自定义指数构建器

AI 总结

Artificial Analysis 在 Data Playground 中推出自定义指数构建器,用户可组合基准、调整权重,并将结果与其他图表坐标轴进行对比。厂商称,模型只有在包含的每项评测都有结果时才会获得自定义指数得分。该平台还提供公式指标、按发布日期回放、热力图、分组箱线图和工作台,并通过 Artificial Analysis Pro 提供。

深度见解

这项更新为 AI 研究者和从业者提供了自定义并可视化模型评测的方法,但现有报告仅包含厂商声明,尚未经过独立验证。

Build your own custom index in the Artificial Analysis Data Playground

Add any Artificial Analysis benchmarks, customize their weights, and plot the results with other chart axis. Models receive a score only if they have results for every evaluation in your index, consistent with the Intelligence Index methodology.

Also in the Data Playground: ➤ Formula metrics: combine any metrics with +, -, *, / and functions such as log and sqrt ➤ Playback: play a scatter chart forward by launch date, with the frontier drawn as it stood at each date ➤ Heat maps across many evaluations, and box plot distributions by group, such as open weights vs proprietary ➤ A workbench with sheets, Columns/Rows shelves and a dashboard view

The Data Playground is available with Artificial Analysis Pro.

#Artificial Analysis#Artificial Analysis Data Playground#Artificial Analysis Pro

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。