OpenRSI Index benchmarks whether AI agents can improve real ML research
OpenRSI Index, launched by the OpenRSI Foundation, has drawn attention on X, where its announcement post has passed 133,000 views. The benchmark draws tasks from real open-source research projects such as Marin, Qwen and GPIC, handing agents existing models, code, data and training recipes to improve, spanning pretraining, post-training and image generation, with the site listing representative single runs at roughly 5,815 to 20,864 H100-hours. Evaluation uses an RSI-Harness that separates the agent's workspace from a clean judging environment, pausing and snapshotting the workspace for scoring; advisers include Luke Zettlemoyer, Karthik Narasimhan, Yejin Choi and Dawn Song, and a companion RSI-Anything pipeline lets researchers turn their own open problems into runnable RSI tasks.
It reframes whether agents can make genuine research progress as a reproducible task with compute limits and independent verification, rather than leaderboard gains.
机器之心 2026-10-11 12:31 北京
从提出想法到跑出结果,AI 研究员到了哪一步?
AI 离超越前沿科研人员还有多远?
近日,OpenRSI Index 在 X 上引发关注。截至目前,项目发布帖已有超过 13.3 万次浏览,相关话题出现在 X 的 Today’s News 栏目中。
#OpenRSI Index#OpenRSI Foundation#RSI-Harness#RSI-Anything#Marin#Qwen#GPIC#Open-Jev