Amazon CloudWatch
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 6
- AWS details a nine-stage AI agent evaluation framework on Bedrock AgentCore
An AWS Machine Learning Blog post describes how AWS's Sales, Marketing, and Global Services (SMGS) Operations team built a continuous quality-evaluation framework for a production multi-agent system on Amazon Bedrock AgentCore Evaluations. The framework spans nine lifecycle stages—defining quality, experimentation, CI merge checks, CD production gates, canary scoring, adversarial testing, live drift detection, a real-time pulse, and an automated feedback loop—and runs at three levels at once: tools, individual sub-agents, and multi-agent orchestration, each with its own golden set and promotion criteria. AWS reports that its internal sales agents produced fluent but wrong answers such as labeling $410.08 of three-month revenue as "$410.08 Million" and presenting estimates as sourced facts while conventional monitoring stayed green; in one pre-production test, mismatched data, tool, and prompt changes dropped the pass rate from 78 percent to 38 percent.
AWS Machine Learning Blog · 🔥 0 - Anchor Browser and Bedrock AgentCore payments let AI agents pay for x402 web resources
An AWS Machine Learning Blog post describes Anchor Browser's Agentic Payments, developed with the AWS Generative AI Innovation Center Partner Agent Factory and now available on AWS Marketplace, which integrates with Amazon Bedrock AgentCore payments so AI agents can pay for x402-protected pages and APIs on their own. When a browser session hits an HTTP 402 Payment Required response, AgentCore payments checks the session budget, signs the transaction through a wallet provider such as Coinbase CDP or Stripe Privy, and the browser retries the request once with the payment header (PAYMENT-SIGNATURE for x402 v2, X-PAYMENT for v1). Developers enable it by setting session.x402 to true, which defaults to false; wallet keys and per-session spending limits stay in managed infrastructure, with payment attempts, approvals, denials and settlements observable via Amazon CloudWatch.
AWS Machine Learning Blog · 🔥 0 - Automating Amazon Bedrock private pricing entitlements
AWS published a walkthrough on using managed entitlements to handle Amazon Bedrock third-party model access across many AWS accounts, so organizations subscribe once from a central account and distribute access via AWS License Manager. It offers two paths: a lightweight one-time script that lists received licenses in a dry run and activates organization-wide grants with --apply, and an event-driven AWS CDK stack that listens for AWS Marketplace agreement events via Amazon EventBridge, verifies a seller allow-list in Lambda, then creates and activates distributed grants with logging to CloudWatch. AWS notes that grant activation and billing visibility can take hours or days to appear.
AWS Machine Learning Blog · 🔥 0 - GPT-6 Sol, Luna, Astra on Amazon Bedrock via global cross-Region inference
An AWS Machine Learning Blog post describes how Amazon Bedrock serves OpenAI's GPT-6 Sol, GPT-6 Luna and GPT-6 Astra through global cross-Region inference from Thailand, Malaysia, Singapore, Indonesia and Taiwan, with GPT-6 Astra callable from Asia Pacific (Singapore) as the source Region. It walks through invocation via the Converse API, the OpenAI-compatible Responses and Chat Completions paths, and the ChatGPT desktop app and Codex CLI (version 0.148 or later), along with IAM and service control policy setup plus quota and monitoring notes. The post states that Sol and Luna accept reasoning effort levels from none to max, while Astra rejects none.
AWS Machine Learning Blog · 🔥 0 - Claude Code on Amazon Bedrock comes to AWS GovCloud for regulated work
An AWS Machine Learning Blog post walks through configuring Anthropic's agentic coding tool Claude Code on Amazon Bedrock in AWS GovCloud (US) regions. The post states Claude Opus 5.5 and Claude Sonnet 5.5 are available there, with Claude Sonnet 5 holding FedRAMP Class D certification and DoD IL4/IL5 authorization, aimed at regulated or ITAR-bound workloads. It details three setup routes — an interactive wizard, manual environment variables, and the Bedrock Mantle endpoint — plus enterprise guidance on pinning model versions, per-user token quotas, IAM Identity Center governance and cost monitoring.
AWS Machine Learning Blog · 🔥 0 - AWS shows layered evaluation for multi-agent systems with AgentCore Evaluations
An AWS blog post explains how to assess multi-agent systems with Amazon Bedrock AgentCore Evaluations, combining built-in evaluators (helpfulness, task success, instruction following, tool selection) with custom evaluators for domain rules such as constraint satisfaction, route feasibility and SQL correctness. The walkthrough uses a fictional retailer, AnyCompany Retail, building a supply-chain decisioning system with the Strands Agents SDK: one orchestrator agent plus optimization, distribution, routing and analytics sub-agents running on AgentCore runtime with memory and observability. A separate explainability layer of six cross-cutting evaluators checks decision rationale, evidence attribution, constraint reasoning, trade-off explanation, tool-use explainability and assumption disclosure; AgentCore Evaluations runs in on-demand mode for benchmarks and CI/CD gates, and online mode to sample production traces into CloudWatch dashboards and alarms.
AWS Machine Learning Blog · 🔥 0
Experience and discussion from the community
Share my Amazon CloudWatch experienceAsk about Amazon CloudWatch
Nobody has shared their experience with Amazon CloudWatch yet.