← Files FactIQARCHIVED FILE

evals/latest-value-direct-answer/graders/answers-in-prose.md

669 Bytes · Nov 2, 2026 · 12:30 UTC

↓ Download file

See the change to this file →

---
type: llm
focus: last_message
weight: 3
---
The final message answers the question directly in prose. All of the following must hold:

1. It states the unemployment rate as 4.1 percent (written as "4.1%" or "4.1 percent").
2. It names the period of that value as August 2026 (or "2026-08").
3. It names the source as the Bureau of Labor Statistics (or "BLS").
4. It is short: at most about three sentences of answer text. A single extra sentence of context is acceptable. A multi-section write-up, a heading structure, or a table of the whole series is not.

Fail if any number other than 4.1 is given as the latest rate, or if the period or the source is missing.

SHA-256: 04588e346003462f88adf6a2fe6b85b5dd62f8c17ded2212b2bc9d068e5929a7