SWE-bench Pro V2
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 2
- Opus-led coding teams did not improve cost-performance
In a Reddit experiment by author /u/Fabulous_Pollution10, Claude Opus 5.5 alone solved 81% of 12 hard coding tasks at $1.20 per task, while pairing it with DeepSeek V4.1 Flash produced 67% at $1.29. Across seven team designs, 41 setups and roughly 1,200 runs, none beat Opus alone and most cost more; the author attributes some failures to weak workers, handoff errors and prompt-cache rebuilding.
r/ClaudeAI · 🔥 0 - Modal explores mixed-precision, mixed-accelerator RL samplers
Modal published a technical post exploring whether large-model reinforcement learning can use samplers at different precisions and on different accelerators while keeping training stable. It says sampling already consumes 80–85% of GPUs in large RL runs, and reports fully asynchronous training of Qwen3.6-35B-A3B on agentic coding tasks using off-policy correction and autoscaling serverless GPUs. Samplers spanned six accelerator types — B200, B300, H100, H200, A100 and RTX PRO 6000 — feeding a BF16 trainer on B200, with evaluation on SWE-bench Pro V2 and its HARD-51 subset.
Modal Blog · 🔥 0
Experience and discussion from the community
Share my SWE-bench Pro V2 experienceAsk about SWE-bench Pro V2
Nobody has shared their experience with SWE-bench Pro V2 yet.