Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

SWE-bench Multilingual

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 2

  1. Penn State study measures coding agents’ termination lag

    A Penn State paper titled “Termination Lag: Coding Agents Solve Early but Stop Late” measures the interval between a coding agent’s first correct patch and when it stops. The study logged repository snapshots during agent runs and replayed them against official SWE-bench tests. Across five models, two agent frameworks and three SWE-bench task sets, the report says a median 35%–60% of steps in successful runs occurred after the first correct patch, while some later changes turned a correct solution into an incorrect one. The findings are based here on a secondary account of the paper.

    掘金 · 人工智能 · 🔥 0
  2. SWE-Trail Guides Coding-Agent Training Data Collection

    SWE-Trail is a trajectory collector that uses earlier coding-agent trajectories to decide where additional collection effort is useful, while keeping that history outside the agent’s context. In the authors’ experiments, a 124B student initialized from Ling-3.0-flash-base improved mean resolution over independent sampling by 2.33 percentage points on SWE-bench Multilingual and 1.60 points on SWE-bench Pro.

    Hugging Face · Papers · 🔥 0

Experience and discussion from the community

Share my SWE-bench Multilingual experienceAsk about SWE-bench Multilingual

Evolver: Let Exploration Leave Behind Strategies

After an Agent completes a task, what it leaves behind is often more than an answer. There is also an expensive exploration path: which files it read, which tools it tried, where it failed, and what checks it used to confirm the result. The problem is that the next execution may not be able to use those experiences. The model parameters have not changed, and a new session will not naturally inheri…

EvolverGEPEvoMapEvolutionSkill