admin
f7ad9ba51f
- introduce Gold Standard evaluation corpus - document decision taxonomy - define prompt-engineering methodology - add regression workflow - establish Prompt Version 2 baseline - validate decision_simple, decision_deferred and decision_none
decision_simple
Tests one explicit decision with clear agreement language.
The difficult part is separating the decision from nearby rationale about user confusion and from the non-decision statement that the copy can stay unchanged for now.
Typical LLM mistakes:
- Extracting the rationale as a separate decision.
- Treating "copy can stay as it is" as a formal decision.
- Losing the evidence that shows explicit agreement.