Establish prompt engineering baseline with Gold Standard tests
- introduce Gold Standard evaluation corpus - document decision taxonomy - define prompt-engineering methodology - add regression workflow - establish Prompt Version 2 baseline - validate decision_simple, decision_deferred and decision_none
This commit is contained in:
@@ -0,0 +1,11 @@
|
||||
# decision_simple
|
||||
|
||||
Tests one explicit decision with clear agreement language.
|
||||
|
||||
The difficult part is separating the decision from nearby rationale about user confusion and from the non-decision statement that the copy can stay unchanged for now.
|
||||
|
||||
Typical LLM mistakes:
|
||||
|
||||
- Extracting the rationale as a separate decision.
|
||||
- Treating "copy can stay as it is" as a formal decision.
|
||||
- Losing the evidence that shows explicit agreement.
|
||||
Reference in New Issue
Block a user