创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

AWS推出JumpStart模型排行榜

AI 总结

AWS宣布推出Amazon SageMaker JumpStart模型排行榜,这是SageMaker Studio中用于并列比较JumpStart模型质量、速度和成本的新视图。据AWS机器学习博客称,该排行榜上线覆盖Meta、Google、Qwen、IBM和Arcee等提供商的70多个模型,并采用AWS运行的基准测试及标准化SageMaker部署测试。用户可以按许可证、提供商和输入输出模态筛选模型,再使用自己的数据和提示测试候选模型。

深度见解

该排行榜让SageMaker用户可以在AWS统一的评测条件下集中比较模型质量、部署性能和估算成本,而无需拼接来自不同来源的数据。

Amazon SageMaker JumpStart gives you hundreds of open-weight foundation models you can deploy quickly. That choice is powerful, but it also creates a real question: Which model should you start with? Comparing models usually means reading model cards one at a time and hunting for benchmark scores that different sources published under different conditions. Then you still must guess how each model will perform, and what it will cost, for your use case.

Today we are launching the Amazon SageMaker JumpStart Model Leaderboard, a new way to compare JumpStart models side by side on quality, speed, and cost, directly in Amazon SageMaker Studio. In this post, we explain what the leaderboard shows, define the key terms in plain language, and walk through how to go from a shortlist to a deployed model.

What is the JumpStart Model Leaderboard?

The leaderboard is a new view of the JumpStart base models page in SageMaker Studio, right next to the Categories and All models views. It uses the same search bar and filters you already know, and it opens on a leaderboard of large language models (LLMs). You see rankings immediately without answering setup questions first. For each model, it shows two kinds of information:

#Amazon SageMaker JumpStart#Amazon SageMaker JumpStart Model Leaderboard#Amazon SageMaker Studio#AWS#Meta#Google#Qwen#IBM#Arcee#BIG-Bench Hard#GPQA Diamond#MMLU-Pro

原文约 9 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。