SlopCodeBench
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Opus 5.5 test challenges SlopCodeBench's code-messiness penalty
A Reddit author ran Opus 5.5 across all 196 SlopCodeBench checkpoints, finding that erosion and verbosity increased in 22 of 35 problems. Messiness did not predict whether the next checkpoint was solved, while about 0.3% of previously passing tests regressed and messier repositories did not regress more often; codebase size, rather than messiness, was associated with higher costs, with the next checkpoint costing about 19% more each time the codebase doubled. The author also reported that cleaner code on the leaderboard had essentially no correlation with solving more problems, while Opus 5.5 passed 84% to 92% of tests for each new specification.
r/ClaudeAI · 🔥 0
Experience and discussion from the community
Share my SlopCodeBench experienceAsk about SlopCodeBench
Nobody has shared their experience with SlopCodeBench yet.