AWS 详解 AAIF:本地小模型与云端模型分流
AWS 机器学习博客发文介绍了基于 Strands Agents 构建的 Adaptive Agentic Intelligence Framework(AAIF)。该框架在本地通过 Ollama 运行 1B 参数的 llama3.2 作为编排模型,对请求进行分类:设备遥测读取、摄像头画面分析等常规任务交给本地小模型处理,复杂分析则经 Amazon Bedrock 交由云端前沿模型完成。文章称这一思路延续了 NVIDIA 的 Belcak 等人的研究观点,即小语言模型对许多智能体调用而言足够强大且更经济,并以物联网监控场景作为参考实现。
文章给出了 AWS 将智能体负载在本地小模型与 Amazon Bedrock 之间分流的参考架构;AWS 称这可降低 API 成本、让常规操作保持低延迟并可离线运行,但未提供独立测量数据。
Organizations building AI agents face a common challenge: Every request, whether a routine status check or complex analysis, typically gets routed to a single large, expensive model. This one-size-fits-all approach can drive up API costs, introduce unpredictable latency, and remove the possibility of offline operation. Even routine queries that could resolve locally end up requiring a full network round-trip to a cloud-hosted large language model (LLM).
The Adaptive Agentic Intelligence Framework (AAIF), built with Strands Agents, takes a different approach. Instead of routing all requests to a single large model, AAIF uses small language models (SLMs) to handle routine tasks locally. More complex requests are routed to cloud-hosted models through Amazon Bedrock. This approach builds on the research position from Belcak et al. at NVIDIA. They argue that small language models are “sufficiently powerful, inherently more suitable, and necessarily more economical for many invocations in agentic systems.” Built on Strands Agents, the framework demonstrates how intelligent model orchestration can help reduce costs while maintaining low latency for local operations.
In this post, we walk through the key components of AAIF using Strands Agents with local SLMs through Ollama and cloud models through Amazon Bedrock. We use an Internet of Things (IoT) monitoring scenario as a reference implementation.
#AWS#Strands Agents#Amazon Bedrock#Ollama#Llama 3.2#NVIDIA#Amazon Nova Lite