← Files DataHub CloudARCHIVED FILE

evals/search-by-tag/graders/response-quality.md

423 Bytes · Oct 9, 2026 · 18:02 UTC

↓ Download file

---
type: llm
focus: last_message
weight: 1
---

PASS if the response:
- Lists both datasets found (customers, orders)
- Identifies them as Snowflake datasets
- Mentions they are tagged PII
- Includes the entity URN or a direct reference for at least one result

FAIL if the response:
- Makes up dataset names not present in the search results
- Omits the tag context entirely
- Is just a raw JSON dump with no explanation

SHA-256: 721da7e9ab11e711b8b0dd1be124e0e8bfd011609d894d4e33219e6e9953e2e5