Google Research releases Harness² for optimizing AI agent harnesses
Google Research open-sourced Harness², a framework that lets AI agents refine the execution harness around them without changing or training the underlying model. According to figures cited by the supplied report from the Harness² paper, reorganizing system prompts, skills, scripts and subagents raised GLM-5 with OpenCode from 64.2 to 75.7 on WorkBuddy-Bench, while Gemini 3.5 Flash with OpenCode rose from 31.5 to 36.0 on JobBench. The framework uses Propose–Probe–Compose: it drafts separate workflow and domain candidates, reruns them on the same task to compare behavior, and selectively combines or retains the current harness. A second layer reviews accepted changes, stores evidence-backed experience in an improvement library and reuses it in later tasks. The report says behavior comparisons can reveal process differences and regressions but cannot reliably establish task correctness, and that improvements may be task-specific and costly to validate in other settings.
The reported benchmark gains with unchanged model weights show that prompts, skills, scripts and subagent organization can materially affect agent performance. Harness² also offers a concrete method for comparing candidate harnesses and retaining execution evidence, although its gains require validation in each deployment and do not establish content correctness.
同一套权重、同一个 OpenCode,只因为把 system prompt、技能、脚本、子代理重新组织了一遍,GLM-5 在 WorkBuddy-Bench 上从 64.2 涨到 75.7。Google Research 开源的 Harness² 想回答一个问题:模型之外的那层"壳",到底值多少分?
一、先说结论
Harness² 干的事情,一句话:不训练模型,也不换模型,只让 agent 自己改自己的 harness(执行外壳),并且把每次改进的经验沉淀下来,让下一个任务受益。
三个关键数字,来自论文(arXiv 2610.14224):
| 场景 | 变化 |
|---|---|
| GLM-5 · OpenCode · WorkBuddy-Bench 均分 | 64.2 → 75.7(+11.5) |
| GLM-5 · OpenCode · LAB 部分通过率 | 59.6% → 71.4%(+11.8pp) |
| Gemini 3.5 Flash · OpenCode · JobBench | 31.5 → 36.0(+4.5) |
#Google Research#Harness²#OpenCode#GLM-5#WorkBuddy-Bench#Gemini 3.5 Flash#JobBench