← Files Intuitive Software DesignARCHIVED FILE

evals/targeted-improvement-heldout-v2/graders/diagnosis.md

454 Bytes · Oct 4, 2026 · 12:34 UTC

↓ Download file

---
type: llm
---
PASS if the answer traces the 23 support contacts to customers being unable to tell which rental they are extending, citing the look-alike rows and the dialog's missing rental identity and current return date, and does not claim that a wrong rental was ever extended.
FAIL if it attributes those contacts to a backend defect, claims wrong rentals were extended, or gives a generic usability diagnosis not tied to the supplied evidence.

SHA-256: 23b90b34122b875ecef941b2fb1051214ea51e9ac4d34cf4cd7c321c22ac96a0