Files
meeting-lab/tests/gold/technical_simple
admin f7ad9ba51f Establish prompt engineering baseline with Gold Standard tests
- introduce Gold Standard evaluation corpus
- document decision taxonomy
- define prompt-engineering methodology
- add regression workflow
- establish Prompt Version 2 baseline
- validate decision_simple, decision_deferred and decision_none
2026-07-30 12:13:10 +02:00
..

technical_simple

Tests technical extraction with a corrected diagnosis.

The transcript contrasts two possible causes: certificate expiry and runner configuration. The latter is confirmed as the cause.

Typical LLM mistakes:

  • Reporting certificate expiry as the problem.
  • Creating a fix decision even though the group explicitly says no fix is decided.
  • Missing the distinction between fact and technical diagnosis.