Establish prompt engineering baseline with Gold Standard tests
- introduce Gold Standard evaluation corpus - document decision taxonomy - define prompt-engineering methodology - add regression workflow - establish Prompt Version 2 baseline - validate decision_simple, decision_deferred and decision_none
This commit is contained in:
@@ -0,0 +1,11 @@
|
||||
# todo_negative
|
||||
|
||||
Tests that vague "someone should" language is not an action item.
|
||||
|
||||
The transcript contains a real decision to keep the issue on the risk list, but no assigned task.
|
||||
|
||||
Typical LLM mistakes:
|
||||
|
||||
- Creating a todo with "someone" as owner.
|
||||
- Assigning Paula, Ravi, or Sam even though they explicitly do not take ownership.
|
||||
- Ignoring the explicit "no owner for now" correction.
|
||||
Reference in New Issue
Block a user