Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

SWE-CoWork

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. SWE-CoWork evaluates coding agents in simulated software organizations

    An arXiv paper introduces SWE-CoWork, a benchmark with 101 development assignments drawn from 101 real repositories, 11 programming languages and 12 application domains. Each assignment places a coding agent in a simulated engineering organization with 26 colleagues, testing its ability to recover requirements, reconcile conflicting information, collaborate, implement changes and verify the work with private executable tests. The paper reports that, among 11 evaluated models, the two leading systems passed roughly 63% of fail-to-pass tests but completed fewer than 8% of assignments. These findings come from the paper and have not been independently verified here.

    Hugging Face · Papers · 🔥 0

Experience and discussion from the community

Share my SWE-CoWork experienceAsk about SWE-CoWork

Nobody has shared their experience with SWE-CoWork yet.