Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Muse Ember Tops Arena's WebDev Small-Model Ranking

AI summary

Arena reported that Meta's Muse Ember (Max) scored 1608 points in the Code Arena WebDev category, ahead of Claude Haiku 5.5 (High) at 1595 and GPT-6 Luna (Max) at 1578. It also recorded a $0.03 median cost per task, putting it on the reported Pareto frontier, while Arena's timed runs averaged about two minutes and $0.04 per task. Arena said all three models had identical API pricing, making their measured task costs and generation performance the key distinction.

In-depth insight

The Arena results position Muse Ember as a notable small model for web-development tasks, combining a leading benchmark score with lower measured task costs and roughly two-minute generation times.

Muse Ember (Max) from @AIatMeta just landed in the Code Arena: WebDev as the highest-performing small model - built for fast, high-quality, low-cost work.

Watch the video below: 20+ websites and animations, all generated by Ember in one go. Across the generations we timed, the average was about 2 minutes and about $0.04 per task.

@arena: Exciting news: @AIatMeta's Muse Ember (Max) is the highest-performing small model in the Code Arena: WebDev with 1608 pts, outperforming two leading small models from Anthropic and OpenAI: - Claude Haiku 5.5 (High): #35, 1595 pts - GPT-6 Luna (Max): #42, 1578 pts At a 1608 score at a median cost of $0.03 per task, this puts Ember on the Pareto frontier. Neither Haiku 5.5 nor Luna makes it. Despite all three models having the same API pricing of $0.10/$0.50 per million input/output tokens, Ember's median cost per task is 2× lower than Luna ($0.06) and 3.7× lower than Haiku ($0.11). In our own testing, Ember demonstrated impressive speed and efficiency, completing 25 complex generations in 2 mins per task, at a total cost of just $1. Huge congrats to @alexandr_wang and the @AIatMeta team on this impressive release! A major step forward for small models that deliver strong real-world coding capabilities at a fraction of the cost. https://x.com/arena/status/2119857775446757697

#Meta#Muse Ember (Max)#Claude Haiku 5.5#GPT-6 Luna#Anthropic#OpenAI#Code Arena WebDev

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.