Standard Bank deploys automated generative AI risk assessment with AWS
Standard Bank Group, working with AWS Professional Services, deployed an automated assessment that scores generative AI use cases against international standards and internal policies. AWS Machine Learning Blog reports that the system uses an unmodified foundation model on Amazon Bedrock as an LLM-as-a-judge to collect evidence, identify mitigations, produce reports and a dashboard, and support existing risk-committee approval gates.
The deployment demonstrates a concrete enterprise approach to automating evidence collection and risk scoring across generative AI use cases, although its accuracy and effectiveness have not been independently validated.
This post is co-written with Tala Qraitem from AWS and Jörg Fischer from Standard Bank Group
Having an AI policy is one thing. Proving, one use case at a time, that AI systems follow it is another. Every new generative AI application adds one more system to prove. Teams can now build one in days, but each still needs a risk committee’s approval before it reaches customers or employees. When that approval depends on reviewers reading documents and testing the system by hand, governance becomes the slowest step in the pipeline.
Standard Bank Group chose to automate that proof. Working with AWS Professional Services, the bank deployed an automated assessment that scores each generative AI use case against international AI standards and its own policies. The assessment produces reports and a dashboard that show what is already in place, what is working well, and what still needs mitigation. This post explains how the assessment runs on AWS and what Standard Bank Group learned from its first runs.
Governing AI with the framework you already have
Standard Bank Group didn’t need a new AI policy. Like most large banks, it already had an established model risk practice that covers concerns such as explainability and fairness, and a change risk process that assesses each new use case according to its level of risk before it goes live.
#Standard Bank Group#AWS#AWS Professional Services#Amazon Bedrock#Amazon S3#AWS Step Functions#AWS Well-Architected Tool#Amazon Bedrock Guardrails