Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

CrossSWE Benchmarks Cross-Repository Coding-Agent Development

AI summary

Researchers introduced CrossSWE, a benchmark of 171 real-world instances spanning 165 repositories, 20 technical domains, and 13 programming languages. Its tasks test dependency reasoning, change propagation, interface consistency, and whether partial repository changes are sufficient. In the authors’ evaluation of five LLMs, the strongest model, GPT-6.1 Sol, achieved 58.48% Pass@1, while cross-repository inconsistencies were the most common failure mode at 44.2%.

In-depth insight

CrossSWE provides coding-agent developers with a concrete evaluation target for coordinated changes across interdependent repositories, while its reported results show that current models still struggle with interface consistency.

Computer Science > Software Engineering

arXiv:2611.01484 (cs)

[Submitted on 1 Nov 2026]

Title:CrossSWE: Benchmarking Cross-Repository Joint Development for Coding Agents

Authors:Silin Chen, Yuling Shi, Heng Lian, Zihan Zhang, Xiaodong Gu, Haotian Lin, Zhensu Sun

View a PDF of the paper titled CrossSWE: Benchmarking Cross-Repository Joint Development for Coding Agents, by Silin Chen and 6 other authors

#CrossSWE#GPT-6.1 Sol

Original · 2 min readRead the original
Group chat

No comments yet. Start the conversation.