Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

GPT-6 Luna system card addendum updates MentalHealthBench results

AI summary

An October 29, 2026 addendum to the GPT-6 Luna System Card reports MentalHealthBench results for the October 29 version. The model scored 48.68 overall, 46.39 on non-acute cases, 53.92 on high-acuity cases and 49.64 on emergent cases. Scores use the task-clipped metric on a 0–100 scale, where higher is better, and are based on four responses per task. The supplied report does not explain what changed between the October 7 and October 29 versions.

In-depth insight

The table compares GPT-6 Luna with several other model versions across MentalHealthBench categories and reports task-level means with one standard error.

Table 6: MentalHealthBench scores, computed using the task-clipped metric. Values show the mean task-level score ± one standard error across tasks, with four responses per task. Scores are on a 0--100 scale; higher is better.

1 Evaluationgpt-5.5Instant(May)gpt-5.5Instant(June)gpt-5.6-sol(August)gpt-5.6-luna(August)gpt-6-sol(October 7)gpt-6-luna(October 7)gpt-6-luna(October 29)
MentalHealthBench (overall) 49.38 ± 0.93 53.93 ± 0.93 47.53 ± 0.97 45.11 ± 0.95 48.81 ± 0.97 51.73 ± 0.96 48.68 ± 0.97
MentalHealthBench (non-acute) 51.91 ± 1.23 52.96 ± 1.26 47.07 ± 1.30 43.10 ± 1.29 47.62 ± 1.31 51.68 ± 1.28 46.39 ± 1.29
MentalHealthBench (high acuity) 50.23 ± 2.17 58.76 ± 2.11 53.88 ± 2.28 52.58 ± 2.19 53.70 ± 2.26 56.15 ± 2.25 53.92 ± 2.28
MentalHealthBench (emergent) 44.03 ± 1.80 52.66 ± 1.81 44.30 ± 1.87 44.12 ± 1.81 47.92 ± 1.89 48.98 ± 1.87 49.64 ± 1.87

#OpenAI#GPT-6 Luna#GPT-6 Sol#GPT-5.5 Instant#GPT-5.6 Sol#GPT-5.6 Luna#MentalHealthBench

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.