Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

SWE-bench Pro V2

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 2

  1. Opus-led coding teams did not improve cost-performance

    In a Reddit experiment by author /u/Fabulous_Pollution10, Claude Opus 5.5 alone solved 81% of 12 hard coding tasks at $1.20 per task, while pairing it with DeepSeek V4.1 Flash produced 67% at $1.29. Across seven team designs, 41 setups and roughly 1,200 runs, none beat Opus alone and most cost more; the author attributes some failures to weak workers, handoff errors and prompt-cache rebuilding.

    r/ClaudeAI · 🔥 0
  2. Modal explores mixed-precision, mixed-accelerator RL samplers

    Modal published a technical post exploring whether large-model reinforcement learning can use samplers at different precisions and on different accelerators while keeping training stable. It says sampling already consumes 80–85% of GPUs in large RL runs, and reports fully asynchronous training of Qwen3.6-35B-A3B on agentic coding tasks using off-policy correction and autoscaling serverless GPUs. Samplers spanned six accelerator types — B200, B300, H100, H200, A100 and RTX PRO 6000 — feeding a BF16 trainer on B200, with evaluation on SWE-bench Pro V2 and its HARD-51 subset.

    Modal Blog · 🔥 0

Experience and discussion from the community

Share my SWE-bench Pro V2 experienceAsk about SWE-bench Pro V2

Nobody has shared their experience with SWE-bench Pro V2 yet.