GPT-6 Luna系统卡附录更新MentalHealthBench结果
AI 总结
GPT-6 Luna系统卡于2026年10月29日发布的附录公布了10月29日版本的MentalHealthBench结果。模型总体得分为48.68,非急性、高危程度和涌现类得分分别为46.39、53.92和49.64。分数采用任务裁剪指标,范围为0至100,分数越高越好;每项任务基于四次回答计算。所提供报告未说明10月7日版与10月29日版之间有何变化。
深度见解
该表将GPT-6 Luna与多个其他模型版本在MentalHealthBench各类别中的表现进行比较,并报告任务级均值和一个标准误。
Table 6: MentalHealthBench scores, computed using the task-clipped metric. Values show the mean task-level score ± one standard error across tasks, with four responses per task. Scores are on a 0--100 scale; higher is better.
| 1 Evaluation | gpt-5.5Instant(May) | gpt-5.5Instant(June) | gpt-5.6-sol(August) | gpt-5.6-luna(August) | gpt-6-sol(October 7) | gpt-6-luna(October 7) | gpt-6-luna(October 29) |
|---|---|---|---|---|---|---|---|
| MentalHealthBench (overall) | 49.38 ± 0.93 | 53.93 ± 0.93 | 47.53 ± 0.97 | 45.11 ± 0.95 | 48.81 ± 0.97 | 51.73 ± 0.96 | 48.68 ± 0.97 |
| MentalHealthBench (non-acute) | 51.91 ± 1.23 | 52.96 ± 1.26 | 47.07 ± 1.30 | 43.10 ± 1.29 | 47.62 ± 1.31 | 51.68 ± 1.28 | 46.39 ± 1.29 |
| MentalHealthBench (high acuity) | 50.23 ± 2.17 | 58.76 ± 2.11 | 53.88 ± 2.28 | 52.58 ± 2.19 | 53.70 ± 2.26 | 56.15 ± 2.25 | 53.92 ± 2.28 |
| MentalHealthBench (emergent) | 44.03 ± 1.80 | 52.66 ± 1.81 | 44.30 ± 1.87 | 44.12 ± 1.81 | 47.92 ± 1.89 | 48.98 ± 1.87 | 49.64 ± 1.87 |
#OpenAI#GPT-6 Luna#GPT-6 Sol#GPT-5.5 Instant#GPT-5.6 Sol#GPT-5.6 Luna#MentalHealthBench