Skip to main content

Over Refusal Rate (ORR) Metrics

The Over Enforcement policy measures the opposite failure: instead of counting attacks that got through, it counts benign prompts your application refused or over-restricted. An assessment run with Over Enforcement (or with a copy of it) therefore reports an Over Refusal Rate (ORR) in place of ASR, and labels each result Violative / None Violative instead of Unsafe / Safe. Lower ORR is better — it means fewer benign prompts were wrongly refused.

Because the two measure different things, they cannot be combined in one report: Over Enforcement runs on its own. See Assessments and Reports for how the picker enforces this.