代码智能体框架升级未必更优
AI 总结
山东大学研究人员刘和韩在固定语言模型的情况下，比较了Claude Code、OpenCode和mini-SWE-agent。多数性能差异与重复运行的噪声相当，但三种框架消耗的令牌量最高达到最轻量方案的三倍；OpenCode在较大任务池中的成绩则显著落后。Terminal-Bench 2.1上的小型交叉验证也呈现相同趋势。
深度见解
该研究指出，代码智能体榜单应同时公布重复运行结果，因为单次运行差距可能源自基准噪声，而非框架设计更优。
Fancy harnesses make coding agents more expensive but not better, study finds
Jonathan Kemper View the LinkedIn Profile of Jonathan Kemper
Oct 24, 2026
Nano Banana Pro prompted by THE DECODER
Makers tout score gains from new agent harnesses like Claude Code or OpenCode. A study finds that claim doesn't hold up. Swapping harnesses barely moves results more than running the same setup twice, but costs can triple.
#Shandong University#Claude Code#OpenCode#mini-SWE-agent#Claude Opus 5#Qwen3.6#Qwen3.8#Deepseek-V4-Flash#GLM-5.3-Flash#HY4-Preview#SWE-bench Verified#Terminal-Bench 2.1