- introduce Gold Standard evaluation corpus - document decision taxonomy - define prompt-engineering methodology - add regression workflow - establish Prompt Version 2 baseline - validate decision_simple, decision_deferred and decision_none
question_simple
Tests extraction of an explicit open question.
The transcript also contains a non-task: Kai says he can ask finance but explicitly does not accept it as a task yet.
Typical LLM mistakes:
- Creating a todo for Kai despite his correction.
- Missing that the group decides to leave the issue open.
- Treating "support package" as enough information to answer the question.