SageMaker AI推出跨区域推理路由
AWS Machine Learning Blog称,Amazon SageMaker AI跨区域推理路由已于2026年11月18日正式可用,覆盖支持实时端点推理的商业区域。Salesforce借此在多个区域和账户的现有端点间路由请求,在保持数据驻留承诺的同时增加模型服务容量。该路由不会创建容量或复制模型,运营方还可限制跨区域流量,保护供本地请求使用的资源。
这项托管路由为Salesforce提供了具备容量感知能力的替代方案,并支持明确控制跨区域流量和数据驻留。
Thanks to Amit Gupta, Senior Director- AI/ML and Mark Wang, Software Engineering PMTS from Salesforce for your contributions in the vision and partnership of cross-Region inference routing on SageMaker AI.
Salesforce’s Agentforce Foundation team serves a wide variety of models for products across Salesforce, including Agentforce and the Salesforce Trust Layer, in 30+ global Regions. These include both models trained in house and open source models. Hosting models separately in each Region splits capacity and makes traffic spikes harder to absorb, which turns a capacity shortfall into an availability problem.
This post shows how Salesforce set up the cross-Region inference routing in SageMaker AI and how it lets the team add capacity securely while keeping its data residency commitments. It also walks through how Salesforce sees where each request was served and why. The cross-Region inference routing gives an application one invocation path across SageMaker AI endpoints in several Regions and accounts, and sends each request to an endpoint that can serve it. Those endpoints are Salesforce’s own, already deployed. The post starts with the capacity problem Salesforce faced, explains how the router works and how Salesforce integrated it into its Internal Gateway, walks through an example setup, and then describes what the team observed.
#Amazon SageMaker AI#AWS#Salesforce#Agentforce#Salesforce Trust Layer