← Files Intuitive Software DesignARCHIVED FILE

evals/redesign-routing-heldout-v2/graders/recovery-states.md

1.11 KB · Oct 2, 2026 · 00:34 UTC

↓ Download file

---
type: llm
---
PASS if the answer covers all three required elements below, in any wording, layout, or mechanism. Parenthetical examples are illustrative, not required. Whether the outcomes it states are established by the materials is judged by a separate criterion, not here.
(1) Recognizing a lapsed member, including the materials' distinction between renewing within 90 days and after 90 days, when a new membership is created (for example, different status messages, or a lookup that branches on the lapse date).
(2) Payment failure: the member's entered details and choices are kept, and the answer says how they can continue or try again (for example, returning to the payment step with selections intact; a dedicated retry control is not required).
(3) A confirmation that states the renewed membership's resulting status in a form the member can refer back to (for example, a confirmation page, email, or account view), rather than a generic thank-you.
FAIL if any required element is missing: no payment-failure handling, no distinction for the over-90-day case, or only a generic thank-you with no durable confirmation.

SHA-256: 96f81c31ef67b696ababd216f57c5ada410b7f233c8b91e15521ac39e43180c1