Benchflow AI
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- FrontierPhysics benchmark launched for end-to-end AI physics research
A paper submitted to arXiv on 4 November 2026 introduces FrontierPhysics, an end-to-end benchmark with 56 tasks made by 42 physicists based on their own research, covering nine domains across theoretical, computational, and experimental physics. Each task requires agents to review the literature, develop a research plan, conduct research and experiments, and produce structured outputs and scientific manuscripts. Scoring combines deterministic verifiers with expert-authored rubrics to judge whether agents' research is correct and publishable. Across 22 models in 26 configurations, no configuration passes more than 46 of its 168 rollouts. Manual review of agent trajectories shows that frontier agents' main weaknesses are insufficiently rigorous reasoning and limited expert intuition, rather than gaps in physics knowledge or execution errors. The benchmark team, drawn from physics labs at Berkeley, Caltech and Harvard, said it recruited 42 physicists from 26 institutions; Artificial Analysis said it was excited to partner to host the evaluation on its platform soon.
Hugging Face · Papers · 🔥 0
Experience and discussion from the community
Share my Benchflow AI experienceAsk about Benchflow AI
Nobody has shared their experience with Benchflow AI yet.