← Files Intuitive Software DesignARCHIVED FILE

evals-holdout/expense-form-wizard/graders/proportionate-change-scope.md

760 Bytes · Oct 2, 2026 · 00:34 UTC

↓ Download file

---
type: llm
---
PASS if the answer's final recommendation keeps the scope of change proportionate to what the evidence supports — given the form's measured 96% completion rate, 2% error rate, 4-minute average completion time, and 88% satisfaction, with only one specific, narrow problem identified (14% of expenses over $75 submitted without the required receipt), the recommendation does not conclude that the entire form should be rebuilt as a full multi-step wizard. A targeted fix, a partial change, or a recommendation to keep the single-page form while addressing the receipt issue all satisfy this. FAIL if the answer's final recommendation is to replace the whole form with a full multi-step wizard, regardless of how that conclusion is justified.

SHA-256: 856a9bc30521b2a9a113df2d2f31f6d7df70f393b8217125f6093c8bd1545b9f