Attack Success Rate (ASR) Metrics
The primary metric is the Attack Success Rate — the percentage of prompts that successfully elicited an unsafe response. Reports break down ASR by:
- Policy — See which policies are most vulnerable (e.g., hate speech, self-harm, prompt injection).
- Assessment category — Separate safety and security findings.
- Prompt count — Understand the statistical significance behind each metric.
Lower ASR is better — it means fewer attacks succeeded.
