Reddit综述编码智能体框架实践
一名Reddit发帖人综合了57篇有关软件开发与编码智能体框架的出版物，认为有效框架应精简、以证据为依据并持续维护。发帖人建议从历史会话和失败中提炼规则，保持指令文件简短，减少工具数量，通过可执行检查落实约束，并删除无法证明有效的规则。帖子还引用多伦多大学研究称，同一模型在不同框架设计下可能出现最高六倍的表现差距，但报告未独立核实相关研究与数据。
该综述从框架设计而非单纯扩大模型的角度，给出了精简规则、设置可执行护栏和减少工具等可操作的编码智能体改进方法。
I think by now most of us have figured out that picking a bigger model isn't necessarily how you get a better agent. What actually matters is how you wrap the model, aka its harness.
And the numbers back this up: Research from the University of Toronto shows the same model produces up to 6x performance gaps depending on harness design, which is wild IMO.
So I got curious what people are actually doing to get those gains. I went through 57 publications to try to get a clearer picture. (FYI I’ve limited the research to harnesses used for software development and coding agents as it’s what I know best.) Here’s what the common practices boil down to, based on that literature research + my own experience:
TLDR: The best harnesses are small, evidence-based and constantly pruned.