OpenAI与Ligo推出湿实验分析基准BioBasicsBench
OpenAI推出由Ligo参与开发的BioBasicsBench。该基准包含100项任务,用于评估AI智能体解读原始实验数据、发现错误,以及识别证据不足以支持结论的能力。任务涵盖蛋白质方法、成像与流式细胞术、定量与检测、核酸方法和分子克隆。科学家使用自身实验数据创建任务,并为每项任务编写专家评分标准。OpenAI称,GPT-6 Astra在xhigh推理强度下的平均奖励为66.7%,GPT-5.6 Sol为43.8%。
BioBasicsBench聚焦直接影响研究可靠性的常规湿实验能力,包括解读原始数据、检查对照以及识别证据不支持的结论。误读图像或忽视对照问题可能造成错误结论,并浪费实验精力。
Our mission is to ensure that artificial general intelligence benefits all of humanity. As part of that mission, we want to help scientists accelerate biological research—from understanding disease to developing new treatments. For AI agents to contribute, they need to reliably interpret the experimental evidence scientists work with every day in wet labs, where they run experiments with biological samples. Everyday wet-lab work involves failed experiments, ambiguous images and conflicting observations. Existing benchmarks are built around charts and images selected for scientific papers may miss this ambiguity and the troubleshooting it requires. That’s why we’re introducing BioBasicsBench, a new benchmark developed with Ligo, a biotech company focused on enzyme design, to measure how well agents handle routine wet-lab analysis.
The benchmark’s 100 tasks test whether agents can interpret raw experimental data, identify errors, and recognize when the evidence cannot support a conclusion. Getting these tasks right matters because misreading an image or overlooking a problem with the controls used to check an experiment’s results can lead scientists to draw the wrong conclusion and spend time on experiments that won’t help answer their question.
#OpenAI#Ligo#BioBasicsBench#GPT-6 Astra#GPT-6.1 Sol#GPT-6 Luna#GPT-5.6 Sol#GPT-5.5#GPT-5.4#GPT-5.2