创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

AA-PersonalityBench比较开放权重与专有模型

AI 总结

Artificial Analysis 使用 AA-PersonalityBench 比较了 Intelligence Index 得分最高的10个开放权重模型和10个专有模型。该基准按30项人格特征对每个模型进行1至100的百分位排名,其中领先开放权重模型的真实性平均比领先专有模型低32个百分点。开放权重模型在实用性和结构方面排名也较低,但在废话和提炼要点方面排名较高。

深度见解

该基准显示,除 Intelligence Index 排名外,领先开放权重模型与专有模型在行为特征上也存在系统性差异。

In AA-PersonalityBench, the top open weights models on average rank lower than the top proprietary models on truthfulness, pragmatism and structure, and higher on slop and summarizing the bottom line

We compared the 10 open weights and 10 proprietary models measured with the highest Artificial Analysis Intelligence Index scores. Each model is percentile ranked from 1 to 100 on each of 30 personality traits. On average, the top open weights models rank 32 points lower than the top proprietary models on Truthful, the largest gap of any trait.

Average rank, top proprietary vs. top open weights:

➤ Open weights rank lower: Truthful (79 vs. 47), Pragmatic (79 vs. 49), Natural Sounding (77 vs. 52), Evidence-Based (76 vs. 47), Structured (73 vs. 45) and Literate (70 vs. 47)

➤ Open weights rank higher: Slop (30 vs. 49), Bottom-Line Summary (47 vs. 62) and Scannable (41 vs. 53)

#Artificial Analysis#AA-PersonalityBench#Artificial Analysis Intelligence Index

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。