FeatureBench
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Coding-Agent Harness Evolution Can Trigger Catastrophic Forgetting
A paper by Shangziqi Zhao, Yitong Zhang, and Jia Li studies continual harness self-evolution across three software-engineering datasets, six evolution directions, and two harness-evolution methods. The authors report that later evolution can substantially reduce performance on earlier tasks: with DeepSeek-V4-Flash-0731, Meta-Harness reportedly fell from 94.0% on SWE-Bench after evolution to 32.0% by the fifth round of subsequent FeatureBench evolution. The paper also presents insights intended to guide continual harness self-evolution.
Hugging Face · Papers · 🔥 0
Experience and discussion from the community
Share my FeatureBench experienceAsk about FeatureBench
Nobody has shared their experience with FeatureBench yet.