- introduce Gold Standard evaluation corpus - document decision taxonomy - define prompt-engineering methodology - add regression workflow - establish Prompt Version 2 baseline - validate decision_simple, decision_deferred and decision_none
12 lines
423 B
Markdown
12 lines
423 B
Markdown
# technical_simple
|
|
|
|
Tests technical extraction with a corrected diagnosis.
|
|
|
|
The transcript contrasts two possible causes: certificate expiry and runner configuration. The latter is confirmed as the cause.
|
|
|
|
Typical LLM mistakes:
|
|
|
|
- Reporting certificate expiry as the problem.
|
|
- Creating a fix decision even though the group explicitly says no fix is decided.
|
|
- Missing the distinction between fact and technical diagnosis.
|