创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

AWS Batch新增SageMaker训练配额管理

AI 总结

AWS推出AWS Batch配额管理这一新调度功能,现已支持Amazon SageMaker Training任务。管理员可按团队、项目或工作负载划分计算容量份额,并配置保留、借出及借出兼借用策略,同时支持跨份额和份额内抢占。SageMaker Python SDK还可将Training任务以编程方式提交至启用配额管理的AWS Batch作业队列。

深度见解

AWS Machine Learning Blog称,该功能可简化多团队GPU资源分配,并帮助组织在共享闲置容量的同时确定工作负载优先级,但其运营效果目前主要由厂商陈述。

With the launch of AWS Batch support for Amazon SageMaker Training jobs, customers gained a new fully managed way to queue, schedule, and retry machine learning (ML) training workloads without building their own infrastructure. Instead, they use the queuing and scheduling features of AWS Batch. As organizations scale their artificial intelligence and machine learning (AI/ML) operations and onboard more teams, coordinating access to shared graphics processing unit (GPU) capacity can introduce additional communication, coordination, and configuration overhead for administrators. This overhead includes setting up separate queues, adjusting capacity limits, and carefully orchestrating the right workloads to get the right resources at the right time. A core value proposition of AWS Batch is helping customers increase utilization of their compute, and as training environments grow, so does the opportunity to do more with existing capacity.

Working backward from customers managing multi-team training environments, we heard a consistent request: give us a way to define allocations per team or project, share idle capacity automatically, and run our highest-priority workloads first. This request led us to build quota management, a new scheduling capability for AWS Batch. Administrators can use it to divide compute capacity into quota shares, organized by team, project, or workload. Each quota share uses configurable resource-sharing strategies that maximize GPU utilization while honoring each team’s allocation when it matters most.

#AWS Batch#Amazon SageMaker Training#SageMaker Python SDK

原文约 8 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。