Book 7 · Lesson 7.2
Quality systems, not heroics
- Name three release gates before demo day
- Contrast eval CI vs manual spot-checking
- Explain when a gate should block release
Prerequisites: 7.1
Heroic EMs catch regressions at midnight. Quality systems catch them in CI.
Eval gate
100% pass
Playwright smoke
4/4 green
Enrichment latency
4.2 ms avg
Release gate: OPEN
Three gates (Stage 5)
| Gate | Command | Blocks when |
|---|---|---|
| Eval regression | pnpm evals:run | Scorer drift on golden cases |
| Playwright smoke | pnpm test:e2e | Dashboard shell or WASM portal break |
| Latency budget | OTel spans | Enrichment p95 exceeds budget |
Toggle the widget — any red gate should block a mock-class demo until fixed.
EM framing
Your team owns the gates. You own the narrative when a gate fails in front of leadership.
Teach-back prompt
Which gate catches a WASM regression vs an LLM scorer rename?