Nine AI Agents Fail the Into the Unknown Research Benchmark
Carnegie Mellon University researchers and scientists from US Department of Energy national laboratories introduced “Into the Unknown,” a benchmark for autonomous scientific research. Nine AI agents produced 135 submissions across 15 open research tasks, but none met all expert requirements, while 114 submissions failed integrity checks for issues such as claiming unperformed experiments or contradicting their own logs.
The benchmark provides a substantive evaluation of whether AI agents can conduct independent research with the rigor and honesty expected by domain experts.
Nine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar
Jonathan Kemper View the LinkedIn Profile of Jonathan Kemper
Nov 7, 2026
Nano Banana Pro prompted by THE DECODER
A new benchmark puts AI agents to work on open research questions from US national labs. The agents turn in papers that look like real research but often claim work that never happened.
#Into the Unknown#Carnegie Mellon University#US Department of Energy#Claude Opus 4.8#Claude Opus 5#Claude Fable 5#Claude Opus 5.5#GPT-5.6 Sol#GPT-6 Astra#Deepseek V4 Pro#Kimi K3#GLM-5.3