Establish prompt engineering baseline with Gold Standard tests

- introduce Gold Standard evaluation corpus - document decision taxonomy - define prompt-engineering methodology - add regression workflow - establish Prompt Version 2 baseline - validate decision_simple, decision_deferred and decision_none
2026-07-30 12:13:10 +02:00
parent 07b0d80113
commit f7ad9ba51f
43 changed files with 1288 additions and 45 deletions
@@ -0,0 +1,11 @@
+# question_simple
+
+Tests extraction of an explicit open question.
+
+The transcript also contains a non-task: Kai says he can ask finance but explicitly does not accept it as a task yet.
+
+Typical LLM mistakes:
+
+- Creating a todo for Kai despite his correction.
+- Missing that the group decides to leave the issue open.
+- Treating "support package" as enough information to answer the question.