- introduce Gold Standard evaluation corpus - document decision taxonomy - define prompt-engineering methodology - add regression workflow - establish Prompt Version 2 baseline - validate decision_simple, decision_deferred and decision_none
12 lines
392 B
Markdown
12 lines
392 B
Markdown
# question_simple
|
|
|
|
Tests extraction of an explicit open question.
|
|
|
|
The transcript also contains a non-task: Kai says he can ask finance but explicitly does not accept it as a task yet.
|
|
|
|
Typical LLM mistakes:
|
|
|
|
- Creating a todo for Kai despite his correction.
|
|
- Missing that the group decides to leave the issue open.
|
|
- Treating "support package" as enough information to answer the question.
|