Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Alibaba releases Qwen4 Max with benchmark gains and lower task cost

AI summary

Artificial Analysis reported that Qwen4 Max scored 43 on its Intelligence Index at xhigh reasoning effort, nine points above Qwen3.8 Max and three points below Kimi K3.1 Pro. It improved on every cited Index evaluation versus Qwen3.8 Max, used 39% fewer output tokens per task, and cost $3.27 per Intelligence Index task, about 11% less than Kimi K3.1 Pro. The model supports a 1M-token context window and text and image input with text output. Alibaba's first-party APIs list pricing of $1.50 per million input tokens and $4.50 per million output tokens.

Alibaba has launched Qwen4 Max, gaining 9 points over Qwen3.8 Max on the Artificial Analysis Intelligence Index and landing 3 points behind Kimi K3.1 Pro at ~11% lower Cost per Task

Qwen4 Max, using xhigh reasoning effort, scores 43 on the Intelligence Index, 9 points ahead of Qwen3.8 Max (xhigh) and 3 points behind Kimi K3.1 Pro (max, 46)

Key takeaways:

➤ Qwen4 Max improves on every evaluation in the Index vs Qwen3.8 Max (xhigh, 34): HLE-Diamond +21 points (24% to 45%), AA-Omniscience +18 points, AutomationBench-AA +17 points, CritPt v2 +13 points, Terminal-Bench-Science +11 points, Terminal-Bench 4.0 +9 points, GDP.pdf +3 points, FrontierCode 2.0 +3 points and AA-Briefcase +82 Elo.

➤ Qwen4 Max costs $3.27 per Intelligence Index task, ~3x less than Qwen3.8 Max ($10.02) and ~11% less than Kimi K3.1 Pro ($3.68): This is driven by 25% lower per-token pricing than Qwen3.8 Max, 70% cheaper cache hits and lower token usage. Tencent Hy4 costs ~3x less per task ($1.03) than Qwen4 Max but scores 8 points lower on the Index.

➤ Qwen4 Max uses 39% fewer output tokens per task than Qwen3.8 Max: ~105k output tokens per Intelligence Index task vs ~171k for Qwen3.8 Max, ~72k for Kimi K3.1 Pro and ~78k for Tencent Hy4. Qwen4 Max uses fewer tokens, while increasing 9 points on the Intelligence Index

#Alibaba#Qwen4 Max#Qwen3.8 Max#Kimi K3.1 Pro#Tencent Hy4#Artificial Analysis

Original · 2 min readRead the original
Group chat

No comments yet. Start the conversation.