- introduce Gold Standard evaluation corpus - document decision taxonomy - define prompt-engineering methodology - add regression workflow - establish Prompt Version 2 baseline - validate decision_simple, decision_deferred and decision_none
12 lines
368 B
Markdown
12 lines
368 B
Markdown
# facts_simple
|
|
|
|
Tests extraction of objective facts from a short status update.
|
|
|
|
The transcript includes a question and a technical statement, but no decision or todo.
|
|
|
|
Typical LLM mistakes:
|
|
|
|
- Treating "Good" as approval of a decision.
|
|
- Turning "No decision needed today" into a decision.
|
|
- Missing that the scanner gateway details are technical as well as factual.
|