From the source
- Standard Bank Group worked with AWS Professional Services to deploy an automated assessment that scores each generative AI use case against international AI standards and the bank's own policies.
- The bank already had a model risk practice covering explainability and fairness and a change risk process, but generative AI adds complexity because models and tooling change every three to six months while each use case must still meet the same security and compliance bar.
- The assessment runs entirely in the bank's own AWS account, keeping documents, code and test results in an
Amazon S3 bucket there, with the AWS Well-Architected Tool handling intake, AWS Step Functions orchestrating the pipeline, and a foundation model on Amazon Bedrock evaluating evidence using an LLM-as-a-judge technique.
- Review and approval stay with the risk committee, which now bases decisions on evidence collected the same way across use cases.
- A pre-assessment agent on AWS Fargate scans the use case's code repository and documentation and pre-populates a custom lens of about 40 questions, each covering a risk event such as incomplete technical documentation or insufficient human oversight.
- The pipeline then checks documents and code against mapped controls, calls the live application through its AWS Lambda function or API, and adds built-in jailbreak attempts and off-topic questions the application is expected to decline.






