← Files Intuitive Software DesignARCHIVED FILE

evals/behavior-confidence-heldout/graders/unobserved-states.md

454 Bytes · Oct 5, 2026 · 18:35 UTC

↓ Download file

---
type: llm
---
PASS if the answer identifies, without being told, at least three consequential conditions the evidence does not show, such as a declined or failed payment, a slow or dropped connection, a repeated tap or retry, rescheduling or cancelling, assistive-technology use, or whether the booking reaches the staff calendar.
FAIL if it names fewer than three such conditions or treats the single successful recording as representative of them.

SHA-256: 8ee154211fd44e990a81e4a1177bbb2ce9c0bf2d48b004b36de785ca1307f946