创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

SageMaker AI推出跨区域推理路由

AI 总结

AWS Machine Learning Blog称,Amazon SageMaker AI跨区域推理路由已于2026年11月18日正式可用,覆盖支持实时端点推理的商业区域。Salesforce借此在多个区域和账户的现有端点间路由请求,在保持数据驻留承诺的同时增加模型服务容量。该路由不会创建容量或复制模型,运营方还可限制跨区域流量,保护供本地请求使用的资源。

深度见解

这项托管路由为Salesforce提供了具备容量感知能力的替代方案,并支持明确控制跨区域流量和数据驻留。

Thanks to Amit Gupta, Senior Director- AI/ML and Mark Wang, Software Engineering PMTS from Salesforce for your contributions in the vision and partnership of cross-Region inference routing on SageMaker AI.

Salesforce’s Agentforce Foundation team serves a wide variety of models for products across Salesforce, including Agentforce and the Salesforce Trust Layer, in 30+ global Regions. These include both models trained in house and open source models. Hosting models separately in each Region splits capacity and makes traffic spikes harder to absorb, which turns a capacity shortfall into an availability problem.

This post shows how Salesforce set up the cross-Region inference routing in SageMaker AI and how it lets the team add capacity securely while keeping its data residency commitments. It also walks through how Salesforce sees where each request was served and why. The cross-Region inference routing gives an application one invocation path across SageMaker AI endpoints in several Regions and accounts, and sends each request to an endpoint that can serve it. Those endpoints are Salesforce’s own, already deployed. The post starts with the capacity problem Salesforce faced, explains how the router works and how Salesforce integrated it into its Internal Gateway, walks through an example setup, and then describes what the team observed.

#Amazon SageMaker AI#AWS#Salesforce#Agentforce#Salesforce Trust Layer

原文约 13 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。