Evaluation Studio

Deterministic-first evaluation against seeded PR diffs. Includes risk prediction accuracy, latency, recall, and category misses.

Pass Rate

100.0%

Risk Accuracy

60.0%

High/Critical Recall

83.3%

Avg Latency

2 ms

Cases

10/10

Case	Expected	Predicted	Pass	Missed Categories	Latency
Low-risk copy change	low	low	Pass	none	8 ms
Medium frontend validation change	medium	low	Pass	none	2 ms
High auth middleware change	high	high	Pass	none	0 ms
Critical destructive migration	critical	critical	Pass	none	1 ms
High payment webhook change	high	high	Pass	none	0 ms
Critical rate-limit bypass	critical	critical	Pass	none	3 ms
Medium cache behavior change	medium	low	Pass	none	0 ms
High env/secrets change	high	high	Pass	none	0 ms
Medium dependency upgrade	medium	low	Pass	none	1 ms
High background job retry change	high	medium	Pass	none	0 ms

Confusion Matrix

{
  "low": {
    "low": 1,
    "medium": 0,
    "high": 0,
    "critical": 0
  },
  "medium": {
    "low": 3,
    "medium": 0,
    "high": 0,
    "critical": 0
  },
  "high": {
    "low": 0,
    "medium": 1,
    "high": 3,
    "critical": 0
  },
  "critical": {
    "low": 0,
    "medium": 0,
    "high": 0,
    "critical": 2
  }
}