Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

GPT-6.2 Astra and Sol trail humans on SimpleBench

AI summary

The SimpleBench Team published a leaderboard for a multiple-choice benchmark with more than 200 questions spanning spatiotemporal reasoning, social intelligence, and linguistic robustness. GPT-6.2 Astra scored 77.3% and GPT-6.2 Sol scored 69.9%, below the stated 83.7% human baseline, though newer models including Claude Fable 5.2 and Gemini 4 Neon ranked above that baseline in the displayed leaderboard.

In-depth insight

The results indicate that both OpenAI models underperformed the benchmark’s reported human baseline on everyday reasoning, while showing that the benchmark’s ranking has since changed with newer models.

SimpleBench

Where Everyday Human Reasoning Still Surpasses Frontier Models

SimpleBench Team

Latest LeaderboardReportTry Yourself

Image 1: Hugging Face

Public Dataset

Some source content is omitted. Continue reading on the original site.

#SimpleBench#GPT-6.2 Astra#GPT-6.2 Sol#OpenAI#Claude Fable 5.2#Gemini 4 Neon

Original · 2 min readRead the original
Group chat

No comments yet. Start the conversation.