Chat Completions API
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Amazon Bedrock Adds Explicit Prompt Caching for Open-Weight Models
AWS announced that open-weight models on Amazon Bedrock now support explicit prompt caching, alongside model-dependent implicit caching. Prompt caching reuses computed state for matching prompt prefixes, while explicit mode lets developers mark reusable content with cache breakpoints through the Chat Completions API. AWS says this can reduce input costs and response latency, but the reported benefits remain vendor claims.
AWS Machine Learning Blog · 🔥 0
Experience and discussion from the community
Share my Chat Completions API experienceAsk about Chat Completions API
Nobody has shared their experience with Chat Completions API yet.