创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Vera Rubin NVL72领跑临时MLPerf智能体测试

AI 总结

NVIDIA称,Vera Rubin NVL72在MLPerf Endpoints v1.0的Kimi K3工作负载中,在满足每用户每秒50个token的最低端到端交互速度下,每配置千瓦吞吐超过GB300 NVL72的10倍。其提交还覆盖Qwen3.6-35B-A3B和DeepSeek-V4.1-Flash,并检查工具调用、工作流意图及任务完成表现。GB300结果已获MLCommons Association验证,但Vera Rubin结果仍为临时结果,尚待同行评审。

深度见解

MLPerf Endpoints v1.0将智能体编程和企业工作流纳入API服务基准,直接衡量推理基础设施在吞吐、响应速度和任务正确性方面的综合表现。

Agentic workloads are demanding more from inference systems. AI agents carry growing conversation histories across turns and generate a mix of reasoning, tool calls, and responses. Inference systems must support users at scale while remaining responsive.

MLPerfEndpoints v1.0 evaluates this balance between serving capacity and responsiveness using coding and enterprise workflows through API endpoints. During performance runs, generated tool calls and workflow intent are checked against reference values. Separate SWE-bench Verified evaluations assess end-to-end task-solving capability. These checks evaluate whether faster serving preserves model quality.

In MLPerfEndpoints v1.0, provisional NVIDIA Vera Rubin NVL72 results show over 10x the throughput per kilowatt of provisioned power of NVIDIA GB300 NVL72 at a shared minimum end-to-end interactivity of 50 tokens per second per user.1

This post presents the benchmark results and outlines the hardware and software optimizations used in the submissions.

1MLPerf® Endpoints v1.0, Kimi K3, Standardized division, Available category, published November 9, 2026. NVIDIA Vera Rubin NVL72, 32 accelerators, result 1.0.1.kimi-k3.agentic_combined.1p, run 9: concurrency = 1,024 queries, TTFT P90 = 4,673.9 ms, system TPS = 41,414.2 tokens/sec, E2E average interactivity = 50.4 tokens/sec per user, operating power = 100.89 kW. NVIDIA GB300 NVL72, 48 accelerators, result 1.0.0.kimi-k3.agentic_combined.1, run 6: concurrency = 48 queries, TTFT P90 = 2,305.1 ms, system TPS = 2,210.4 tokens/sec, E2E average interactivity = 56.2 tokens/sec per user, operating power = 60 kW. Comparison based on throughput per kilowatt at a shared minimum E2E average interactivity of 50 tokens/sec per user. Retrieved from endpoints.mlcommons.org on November 9, 2026. GB300 results verified by MLCommons Association. For the provisional Vera Rubin results: pending MLCommons Association verification, results are subject to change pending peer review. The MLPerf name and logo are registered and unregistered trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use is strictly prohibited. See www.mlcommons.org for more information.

#NVIDIA#NVIDIA Vera Rubin NVL72#NVIDIA GB300 NVL72#MLPerf Endpoints v1.0#MLCommons Association#Kimi K3#Qwen3.6-35B-A3B#DeepSeek-V4.1-Flash#SWE-bench Verified

原文约 6 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。