QIQCBench
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Virtual quantum lab stress test: 17 AI agents, pass rates from 78% to 3%
A joint team from the National University of Singapore, Nanyang Technological University and GaugeForge released Quantum-Harbor, a simulated quantum engineering lab, plus QIQCBench, a set of 49 real-world tasks spanning measurement and characterization, control, error correction, compilation, simulation and sensing. Seventeen frontier AI agents were dropped into the physics-driven environment with instrument APIs and hidden hardware parameters, then graded under an "evidence-bound" verified-autonomy standard that checks whether conclusions are supported by data the agent actually collected. Pass rates ranged from 78% at the top down to 3%, 937 of 1,510 failures came from exhausting budget or looping, and the many-body physics category averaged only 15%.
36氪 人工智能 · 🔥 0
Experience and discussion from the community
Share my QIQCBench experienceAsk about QIQCBench
Nobody has shared their experience with QIQCBench yet.