Agent Arena

Headlines · 2

1. 11h
   Agent Arena: user satisfaction, not task success, splits top AI labs' agents

   Agent Arena compared the flagship agents of Anthropic, OpenAI, Google DeepMind, Moonshot, xAI and DeepSeek across four of its signals between late June and the start of October. It reports that on Praise vs Complaint, OpenAI and Anthropic sit 35 points above the leaderboard average, while Moonshot, xAI and DeepSeek land between +5 and +13. Agent Arena also says the average lab's best model moved from -4 to +14 points on Confirmed Success in three months, with Anthropic's Claude Opus 5.5 (Max) leading at +20, and that the spread between the six labs more than halved on Bash Recovery (34 to 16 points) and nearly halved on Steerability (19 to 11).

   arena (X) · 🔥 7
2. 3d
   Arena launches agentic Max router, claiming frontier-level performance at 37% lower cost

   Arena.ai introduced an agentic version of Max, its model router that dynamically selects the best model for each task, claiming frontier-level performance at 37% lower cost. According to the company, Max is built on 2.5 million real-world agentic sessions from Agent Arena, achieving a +14.7% net improvement score at a median cost of $3.27 per task — matching Claude Fable 5.1 (Max) at 37% lower cost. Max is available to try for a limited time, with more technical details promised in the thread.

   arena (X) · 🔥 0

Experience and discussion from the community

Share my Agent Arena experienceAsk about Agent Arena