RepoZero

Headlines · 1

1. Oct 19
   Study finds dynamic concurrency in coding agents helps long tasks but hurts short ones

   Researchers from Nanjing University and UIUC ran paired experiments on the dynamic concurrency mechanisms of three coding agents — Codex, Claude Code and Kimi Code — across 354 software engineering tasks and 2,124 executions, analysing full main-agent and sub-agent traces. Results varied by task type and system: on LoopsBench, Claude Code's completion rate rose from 7.1% sequentially to 21.4% with concurrency, and Codex rose from 34.6% to 57.7% on NL2Repo; on SWE-bench Verified, Claude Code fell from 83.0% to 59.0% and Kimi Code from 77.0% to 59.0%, while Codex stayed at 71.0% in both modes. Trace analysis produced a taxonomy of 4 categories, 13 subcategories and 28 concurrency failure modes (such as missing owners, pseudo-concurrency, load imbalance, mistimed result merging and shared-environment conflicts), plus three mechanisms where concurrency paid off: complementary work, parallel exploration and independent verification.

   新智元 · 🔥 0

Experience and discussion from the community

Share my RepoZero experienceAsk about RepoZero