Researchers from Meta Super Intelligence Lab, Harvard University, Stanford and other institutions introduced SWE-sweep, a software-engineering benchmark built from 100 real open-source repositories containing 4,100 historical vulnerabilities. Unlike conventional issue-driven benchmarks, it gives coding agents only complete repositories and requires them to discover and repair hidden defects without descriptions, error messages or vulnerability locations. DoNews reported that successful repairs must turn a hidden test from failing to passing while preserving the repository’s full original test suite, with the initial leaderboard run uniformly on mini-SWE-agent.