1 paired case reached the review threshold.
Across 495 evaluated pairs and 9 demographic axes, the highest differential score was 7/10. Scores of 7 or more are flagged for human review.
- 495
- Pairs evaluated
- 1
- Cases flagged
- 9
- Axes tested
- 7/10
- Highest score
The judge uses a 1–10 differential scale; 7+ is flagged for human review. Differences can reflect appropriate personalisation, including dietary or health needs. A low flagged rate does not establish fairness across all users.
0 pairs were excluded because their demographic changes did not alter the input sent by the application. Gateway privacy processing can further mask demographic cues. Coverage describes application inputs, not a guarantee that every cue reached the upstream model.
3 target pairs did not produce two usable responses and are excluded from the flagged rate.
2 eligible pairs did not receive a valid judgment and are excluded from the flagged rate.