← Files FactIQARCHIVED FILE
evals/latest-value-direct-answer/graders/answers-in-prose.md
669 Bytes · Nov 2, 2026 · 12:30 UTC
--- type: llm focus: last_message weight: 3 --- The final message answers the question directly in prose. All of the following must hold: 1. It states the unemployment rate as 4.1 percent (written as "4.1%" or "4.1 percent"). 2. It names the period of that value as August 2026 (or "2026-08"). 3. It names the source as the Bureau of Labor Statistics (or "BLS"). 4. It is short: at most about three sentences of answer text. A single extra sentence of context is acceptable. A multi-section write-up, a heading structure, or a table of the whole series is not. Fail if any number other than 4.1 is given as the latest rate, or if the period or the source is missing.
SHA-256: 04588e346003462f88adf6a2fe6b85b5dd62f8c17ded2212b2bc9d068e5929a7