Standard Bank与AWS部署生成式AI风险评估
Standard Bank Group与AWS Professional Services合作部署了一套自动评估系统,依据国际标准和内部政策为各生成式AI用例评分。AWS Machine Learning Blog称,该系统使用Amazon Bedrock上未经微调的基础模型充当LLM-as-a-judge,收集证据、识别缓解措施、生成报告和仪表板,并为现有风险委员会审批提供支持。
这一部署展示了自动收集证据并为多个生成式AI用例评分的企业级治理方案,但其准确性和有效性尚未得到独立验证。
This post is co-written with Tala Qraitem from AWS and Jörg Fischer from Standard Bank Group
Having an AI policy is one thing. Proving, one use case at a time, that AI systems follow it is another. Every new generative AI application adds one more system to prove. Teams can now build one in days, but each still needs a risk committee’s approval before it reaches customers or employees. When that approval depends on reviewers reading documents and testing the system by hand, governance becomes the slowest step in the pipeline.
Standard Bank Group chose to automate that proof. Working with AWS Professional Services, the bank deployed an automated assessment that scores each generative AI use case against international AI standards and its own policies. The assessment produces reports and a dashboard that show what is already in place, what is working well, and what still needs mitigation. This post explains how the assessment runs on AWS and what Standard Bank Group learned from its first runs.
Governing AI with the framework you already have
Standard Bank Group didn’t need a new AI policy. Like most large banks, it already had an established model risk practice that covers concerns such as explainability and fairness, and a change risk process that assesses each new use case according to its level of risk before it goes live.
#Standard Bank Group#AWS#AWS Professional Services#Amazon Bedrock#Amazon S3#AWS Step Functions#AWS Well-Architected Tool#Amazon Bedrock Guardrails