← Files Intuitive Software DesignARCHIVED FILE

evals/targeted-improvement-heldout-v2/graders/failure-states.md

780 Bytes · Oct 5, 2026 · 18:35 UTC

↓ Download file

---
type: llm
---
PASS if the answer covers both required elements below, in any wording or mechanism. Parenthetical examples are illustrative, not required.
(1) The rule that a new return date cannot fall after the unit's next reservation, handled so the customer is never left with an unexplained rejection: they can learn the limit before committing, or a rejected request explains why and what they can do next (for example, showing the latest allowed date, disabling later dates, or an inline message that keeps the chosen date).
(2) What the customer sees if the rental changed after the dialog opened (for example, it was already extended or returned elsewhere).
FAIL if it ignores the reservation rule or the changed-rental case, or leaves a rejected request unexplained.

SHA-256: 1ac17956ffafce51cf6cbf8a94da62641a26a2f1602245428bf84c7828977510