← Files Intuitive Software DesignARCHIVED FILE
evals/targeted-improvement-heldout-v2/graders/diagnosis.md
454 Bytes · Oct 5, 2026 · 18:35 UTC
--- type: llm --- PASS if the answer traces the 23 support contacts to customers being unable to tell which rental they are extending, citing the look-alike rows and the dialog's missing rental identity and current return date, and does not claim that a wrong rental was ever extended. FAIL if it attributes those contacts to a backend defect, claims wrong rentals were extended, or gives a generic usability diagnosis not tied to the supplied evidence.
SHA-256: 23b90b34122b875ecef941b2fb1051214ea51e9ac4d34cf4cd7c321c22ac96a0