Amazon Bedrock
Turn on Bedrock model invocation logging, point it at S3 or CloudWatch, and let a Lambda forward each logged prompt and response to Alice. Findings, case management and user-level workflows such as a three-strikes rule then run in the Alice platform, next to any Amazon Bedrock Guardrails verdicts you already have. No change to the application; evaluation happens after the fact.
Status: Generally available · Evaluates: Observability · Vendor: AWS
Prompts and responses read from Bedrock model invocation logs, plus images.
Setup
- Enable model invocation logging on Bedrock, to S3 or CloudWatch Logs.
- Deploy a Lambda that triggers on new log objects and calls the Alice evaluate API with each prompt and response (the AWS sample Custom Observability Solution is the pattern).
- Optionally attach Amazon Bedrock Guardrails (for example a denied topic) and send its score to Alice as a custom field.
- Review items, scores and user-level policies in the Alice platform.