Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Report: Muse Ember leads GPT-6 Luna and Claude Haiku 5.5 on speed, performance and cost

AI summary

A report on Meta's Muse Ember says the model in Max mode leads GPT-6 Luna (Max) from OpenAI and Claude Haiku 5.5 (High) from Anthropic on every dimension measured in the Agent Arena evaluation. Reported speed is 27 seconds per task, against 5.8 minutes for GPT-6 Luna and 1.9 minutes for Claude Haiku 5.5, described as roughly 13 times faster than Luna. Performance is reported as +2.3% net improvement on the Agent Arena score, versus +1.4% and +0.4%, and cost is 1.9 cents per task, against 7.0 cents and 6.9 cents — less than a third of either. The figures come from a single report, which also points to further analysis of Ember's steerability across Work and to real-world tasks users are shipping with Muse Ember in the Agent Arena.

The race among efficient models built for real work has a new leader: Muse Ember by @AIatMeta.

Ember (Max) leads on every dimension against GPT-6 Luna (Max) from @OpenAI and Claude Haiku 5.5 (High) by @AnthropicAI:

- Speed: 27s per task vs 5.8 min and 1.9 min - Performance: +2.3% Net Improvement (Agent Arena score) vs +1.4% and +0.4% - Cost: 1.9¢ per task vs 7.0¢ and 6.9¢

That’s ~13x faster than Luna and less than a third of the cost of either. Below find more analysis on Ember’s steerability score across Work, and a look at what real-world tasks users are shipping with Muse Ember in the Agent Arena.

#Muse Ember#Meta#GPT-6 Luna#OpenAI#Claude Haiku 5.5#Anthropic

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.