← Files FactIQARCHIVED FILE

evals/yoy-across-a-missing-month/graders/yoy-values-are-date-matched.md

860 Bytes · Nov 2, 2026 · 12:30 UTC

↓ Download file

See the change to this file →

---
type: llm
focus: last_message
weight: 4
---
The answer compares each month with the same calendar month one year earlier. Check the reported year-over-year changes, in percentage points, against these correct values:

- November 2025: +0.3
- December 2025: +0.3
- January 2026: +0.3
- February 2026: +0.2
- July 2026: -0.2
- August 2026: -0.2

Pass only if every one of these six months is reported with the correct value (sign and magnitude). Wording may vary: "+0.3pp", "0.3 percentage points higher", "up 0.3" are all acceptable.

Fail if the answer reports November 2025 as +0.4, December 2025 as +0.2, or July 2026 as -0.1. Those are the values produced by counting twelve rows back instead of matching the calendar month, and the series has a missing month that makes the two methods differ.

Fail if any of the six months is absent from the answer.

SHA-256: 3d6dfbc6957296d246e5e767d23ce83e134b92aa179d824cb6988100f3ba80cd