Establish prompt engineering baseline with Gold Standard tests

- introduce Gold Standard evaluation corpus
- document decision taxonomy
- define prompt-engineering methodology
- add regression workflow
- establish Prompt Version 2 baseline
- validate decision_simple, decision_deferred and decision_none
This commit is contained in:
2026-07-30 12:13:10 +02:00
parent 07b0d80113
commit f7ad9ba51f
43 changed files with 1288 additions and 45 deletions
+11
View File
@@ -0,0 +1,11 @@
# todo_negative
Tests that vague "someone should" language is not an action item.
The transcript contains a real decision to keep the issue on the risk list, but no assigned task.
Typical LLM mistakes:
- Creating a todo with "someone" as owner.
- Assigning Paula, Ravi, or Sam even though they explicitly do not take ownership.
- Ignoring the explicit "no owner for now" correction.