← Files FactIQARCHIVED FILE

evals/unrelated-coding-request/graders/answers-the-python-question.md

407 Bytes · Nov 2, 2026 · 12:30 UTC

↓ Download file

See the change to this file →

---
type: llm
focus: last_message
weight: 3
---
The final message answers the Python question. It must say that `list.sort()` sorts the list in place and returns None, and that `sorted()` leaves the original unchanged and returns a new list.

Pass if both points are made, in any wording. Fail if the model asks for clarification instead of answering, or if it talks about economic data, charts, or FactIQ.

SHA-256: 4db03d4fcb5e4bb6a04162e0dad4b5db3fef97d145103d64bfb041b50946f12a