Arena.ai

Headlines · 4

1. 2d
   Meta's Muse Wonder (Max) debuts at #12 in Agent Arena, topping Muse Spark 1.3

   Arena.ai published results from more than 5,000 real-world agentic sessions showing Meta's Muse Wonder (Max) entering the Agent Arena at #12 with a +6.4% net improvement, 2.8 points and four places above Muse Spark 1.3 (Max) at #16 with +3.6%. The gain comes at a higher price: a $1.13 median cost per task versus $0.54 for Spark 1.3, about 2.1x. Arena describes Muse Wonder (Max) as cost-efficient relative to nearby models — within 1 percentage point of #10 GPT-5.6 Sol (xHigh) at 25% lower cost, and within 2 points of #9 Claude Fable 5 (High) at 67% lower cost. By category it leads Muse Spark 1.3 in Chat (#12, +6.5% vs #15, +3.3%), Work (#13, +6.8% vs #18, +3.7%) and Code (#15, +5.2% vs #18, +4.2%), but in Code Arena: WebDev it placed #15 with 1651 points, slightly below Muse Spark 1.3's #12 and 1659 points, while landing #2 in Text Arena with 1513 points.

   arena (X) · 🔥 0
2. 3d
   Arena launches agentic Max router, claiming frontier-level performance at 37% lower cost

   Arena.ai introduced an agentic version of Max, its model router that dynamically selects the best model for each task, claiming frontier-level performance at 37% lower cost. According to the company, Max is built on 2.5 million real-world agentic sessions from Agent Arena, achieving a +14.7% net improvement score at a median cost of $3.27 per task — matching Claude Fable 5.1 (Max) at 37% lower cost. Max is available to try for a limited time, with more technical details promised in the thread.

   arena (X) · 🔥 0
3. Oct 8
   Arena launches Alignment Index benchmark for AI agent safety

   Arena.ai introduced the Arena Alignment Index, a new benchmark for measuring the safety and alignment of AI agents in real-world use. The company says it is built from more than 90,000 real-world agent sessions across 27 models and tracks three critical signals, one of which is Unauthorized Action (UA), described as taking actions beyond what was authorized. Boris Power, whose post was reshared in the announcement, said models are becoming much more aligned quickly, a claim attributed to him rather than independently verified.

   arena (X) · 🔥 0
4. Oct 8
   OpenAI's ChatGPT Work and Codex pass 40M weekly active users

   Thibault Sottiaux, who leads OpenAI's core products and platform, said ChatGPT Work and Codex have reached a new high of 40 million active users. Peter Gostev, who heads the Arena.ai (LMArena) evaluation platform, projected that if the trend continues the figure would reach roughly 70 million by year-end and about 100 million by the end of March 2027 — a third-party estimate, not OpenAI guidance.

   DoNews · 🔥 0

Experience and discussion from the community

Share my Arena.ai experienceAsk about Arena.ai