← Files Intuitive Software DesignARCHIVED FILE

evals/targeted-improvement-heldout-v2/prompt.md

1.33 KB · Oct 4, 2026 · 12:34 UTC

↓ Download file

---
description: Version 2 of targeted-improvement-heldout. Adds evidence that a rental can change while the extension dialog is open. Scores are not comparable with version 1 runs.
max_turns: 15
allowed_tools: [Read, Glob, Grep, Skill]
---
Customers on our equipment-rental portal can extend an active rental from their dashboard. Can you suggest a focused improvement to the extension flow? Here's what we know:

- Dashboard: a list of active rentals; each row shows the equipment name and a "Manage" button. A customer renting two units of the same model sees two rows that look the same.
- "Extend return" dialog: the title "Extend return", a date picker labeled "New return date", and a "Confirm extension" button. Nothing else is shown.
- Support log for last month: 23 contacts asking which rental an extension applied to. None reported the wrong rental being extended.
- Backend note: the extension request updates the rental whose ID the dashboard row passed. It rejects a new return date that falls after the unit's next reservation.
- Account note: business accounts can have several authorized users, and an open "Extend return" dialog does not refresh. Last month two customers confirmed an extension for a rental that a colleague had already returned; both saw only "Something went wrong."
- There are no usability sessions or funnel analytics.

SHA-256: 4d0bf43cc73bf339b756823109e25bc7dd7f7054359c88ce91233d251b8a171b