Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

DeepSWE 1.1

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 2

  1. Reddit post breaks down ERNIE 5.5 Flash coding benchmark index

    A Reddit user presented ERNIE 5.5 Flash Preview as a 280B-parameter model with 14B active parameters and highlighted an “Agentic Coding” aggregate index. The post says the index combines 12 coding-related benchmarks, led by Terminal-Bench v4.0 at 16% and DeepSWE v1.1 at 15%, rather than representing the separate AA index. The author cautioned that the AA index relies on only two coding benchmarks and therefore does not reflect actual software-engineering capabilities.

    r/LocalLLaMA · 🔥 0
  2. Meta's Muse Wonder draws benchmaxxing claims after lava-lamp test flop

    Meta released Muse Wonder and Muse Wonder Full on October 12, with official figures putting Wonder Full at 57.5 on SWE-Marathon and 79.0 on DeepSWE 1.1. The developer community BridgeMind then asked Muse Wonder to build a lava lamp with a transparent glass shell, moving lava and lighting effects, and the model produced only a red cylinder, prompting BridgeMind to accuse it of "Benchmaxxing" for benchmark scores. Meta chief AI officer Alexandr Wang responded that the team had not explicitly trained for 3D demo games and might add such training, while Meta's model card lists vision and spatial reasoning, especially 3D tasks, as a known weakness and states that SWE-Marathon was not a controlled comparison under a uniform harness, since GPT-6 Astra used Codex and Claude Fable 5.1 used Claude Code. Elon Musk replied "Hmm" to a related post.

    虎嗅 AI · 🔥 0

Experience and discussion from the community

Share my DeepSWE 1.1 experienceAsk about DeepSWE 1.1

Meta²: Carrying Experience Forward and Adjusting Along the Way

The difficulty in getting an agent to complete a long task often lies midway through. It may have already written the code but missed the actual delivery steps; it may also have simply encountered an ordinary error and be looking for an alternative on its own. At this point, we want it to correct its course promptly, but we also don't want to interrupt it every time something happens. Meta² studi…

MetaHarnessTerminal-Bench 2.1RSI

arxiv.orghttps://arxiv.org/abs/2611.05139