← Files LLM & Agent Builder CopilotARCHIVED FILE
benchmarks/README.md
726 Bytes · Nov 11, 2026 · 12:40 UTC
# Acceptance benchmark instructions The 28 prompt cases are **specifications**, not recorded passes. After the plugin is installed, run each against the chosen host, capture actual outputs, relevant tool traces and approvals, then score against `expected_signals` with human review for quality and deterministic tests for schemas/permissions. Preserve version, inputs and exact results. Do not claim benchmark completion from the existence of this file. Negative cases cover unnecessary multi-agent design, unsafe permissions, fabricated results, prompt injection, tenant leakage, stale approvals, unsafe retries and fabricated parallelism. A critical authorization failure blocks release independently of aggregate quality.
SHA-256: e37708077e27efe93cb6c1fb7b6ce952725cdd9a405f81378aa9d63916250e02