← Files DataHub CloudARCHIVED FILE

evals/lineage-upstream/graders/response-quality.md

462 Bytes · Oct 9, 2026 · 18:02 UTC

↓ Download file

---
type: llm
focus: last_message
weight: 1
---

PASS if the response:
- Identifies both upstream sources (the Kafka topic orders-events and the dbt staging model stg_orders)
- Clearly describes the direction as upstream (where the data comes from)
- Mentions the platforms (Kafka, dbt)

FAIL if the response:
- Confuses upstream and downstream
- Invents sources not present in the lineage results
- Reports only one upstream source without explaining the other

SHA-256: 6af1d5d50543a1e31dbc0246f3c6087a89f06dec0b4accb93be397e79adae7f8