admin
f7ad9ba51f
- introduce Gold Standard evaluation corpus - document decision taxonomy - define prompt-engineering methodology - add regression workflow - establish Prompt Version 2 baseline - validate decision_simple, decision_deferred and decision_none
22 lines
721 B
Markdown
22 lines
721 B
Markdown
# decision_none
|
|
|
|
Tests a true decision-negative meeting segment.
|
|
|
|
The transcript contains discussion, competing preferences, and possible options
|
|
for the weekly dashboard. No participant approves an option, rejects an option
|
|
on behalf of the group, assigns a follow-up, agrees to gather more information,
|
|
or explicitly decides to defer the decision.
|
|
|
|
Ground truth:
|
|
|
|
- No decision was reached.
|
|
- No process decision was reached.
|
|
- No agreed next step was created.
|
|
|
|
Typical LLM mistakes:
|
|
|
|
- Treating a preference as a decision.
|
|
- Treating a proposed option as the selected option.
|
|
- Treating the topic change as an implicit deferral decision.
|
|
- Creating an action item for Dana even though she is only mentioned as absent.
|