LiveCodeBench
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Paper reports coding gains from ledger-based self-orchestration
A paper introduces ledger-based zero-shot self-orchestration, a training-free method in which fresh instances of the same model decompose problems and coordinate through a shared filesystem containing a plan, notes, and the current solution. The authors evaluated 11 open- and closed-weight models on the 100 latest hard LiveCodeBench problems and reported gains of up to 25.6 percentage points on pinned backends. They report that orchestrated Qwen3.8 Flash Next reached 93.0% pass@1 versus Fable 5's 90.4% at 9% of the cost, while locally served Qwen3.8-27B rose from 66.8% to 92.4%. The gains were not universal: some models were unchanged or performed worse.
Hacker News 首页(100+ 分) · 🔥 0
Experience and discussion from the community
Share my LiveCodeBench experienceAsk about LiveCodeBench
Nobody has shared their experience with LiveCodeBench yet.