创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Amazon Bedrock开放权重模型新增显式提示缓存

AI 总结

AWS宣布,Amazon Bedrock上的开放权重模型现已支持显式提示缓存,并可根据模型继续提供隐式缓存。提示缓存可复用匹配前缀的计算状态,显式模式则允许开发者通过Chat Completions API设置缓存断点。AWS称这有助于降低输入成本和响应延迟,但相关效果主要来自厂商说明。

深度见解

显式缓存让开发者能更精确地复用智能体循环、共享指令和参考文档中的长上下文。

Many generative AI applications send the same long context with every request, and prompt caching avoids processing it again each time. That context can be a system prompt, reference documents, tool definitions, or the conversation so far. Open-weight models on Amazon Bedrock can reuse it across requests, which helps reduce input costs and response latency.

Prompt caching reuses the computed state of a matching prompt prefix, so repeated context is read from cache instead of being processed again. Amazon Bedrock manages the cache for you. Depending on the model, you can use implicit caching, which works automatically, explicit caching, where you mark the reusable prefix, or both. The more context you reuse, and the more often you reuse it, the more you can save.

As with other models on Amazon Bedrock, your prompts and outputs aren’t shared with the model provider or used to train models. For more information, see Data protection in the Amazon Bedrock User Guide.

Open-weight models on Amazon Bedrock now support explicit prompt caching. In this post, we use both modes with an open-weight model through the Chat Completions API and show how to read cache usage from each response. We then apply implicit caching to an OpenCode coding agent session on the same API and close with best practices.

#Amazon Bedrock#AWS#OpenCode#Chat Completions API

原文约 13 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。