SWE-sweep

Headlines · 1

1. Oct 23
   SWE-sweep Tests AI Agents Finding Hidden Bugs Without Issue Hints

   Researchers from Meta Super Intelligence Lab, Harvard University, Stanford and other institutions introduced SWE-sweep, a software-engineering benchmark built from 100 real open-source repositories containing 4,100 historical vulnerabilities. Unlike conventional issue-driven benchmarks, it gives coding agents only complete repositories and requires them to discover and repair hidden defects without descriptions, error messages or vulnerability locations. DoNews reported that successful repairs must turn a hidden test from failing to passing while preserving the repository’s full original test suite, with the initial leaderboard run uniformly on mini-SWE-agent.

   DoNews · 🔥 0

Experience and discussion from the community

Share my SWE-sweep experienceAsk about SWE-sweep