Add Vanheede real-world regression case

2026-09-15 16:43:45 +02:00
parent 21082e66b3
commit 0cc86deb67
15 changed files with 2136 additions and 0 deletions
@@ -0,0 +1,41 @@
+# Vanheede–Naue recycled-HDPE meeting — 2026-09-14
+
+Durable private real-world regression and reference case for an English meeting between Naue and Vanheede. The source recording contains non-native English speech; the persisted source metadata does not record speakers' native languages or accents, so those descriptions are retained only as the operator context that motivated preservation.
+
+## Case metadata
+
+- **Case ID:** `vanheede_naue_recycled_hdpe_2026-09-14`
+- **Meeting/run:** `Vanheede and Naue, Recycling and Circular Economy` / `d7189066_2026-09-14_16-00-18_Recycled_HDPE_20260915_145952`
+- **Source meeting date:** 2026-09-14
+- **Run completed:** 2026-09-15T14:59:52+02:00
+- **Language:** English
+- **Duration:** 3,433.92 s (57 m 13.92 s)
+- **Participants:** Christian Psiorz, Martin Tazl, Dries Nollet, and Jorik Muylle
+
+## Purpose and scope
+
+This case is an evidentiary reference for English protocol generation from diarized, non-native speech. It preserves two immutable source generations:
+
+| Variant | Source generation | Confirmed mappings in prompt | Role in this case |
+| --- | --- | ---: | --- |
+| `001` | `protocol/generations/001` | 0 | Tests the limits of name use from participant-list and discourse evidence. |
+| `002` | `protocol/generations/002` | 4 | Primary final reference: all speaker identities are explicitly mapped. |
+
+The compact diarized protocol input is byte-identical between the two generations. Their prompts differ because only generation 002 includes the four authoritative mappings. `speaker_identity_analysis.md` deliberately separates direct transcript support from assignments that could result merely from the participant list.
+
+## Contents
+
+- `transcript/source_transcript.txt`: source compact plain transcript.
+- `transcript/diarized_transcript.txt`: timestamped diarized transcript.
+- `transcript/protocol_input.txt`: exact compact diarized input supplied to both protocol generations.
+- `context/meeting_context.yaml`: authoritative participant/context record, including the final explicit mappings.
+- `protocol_generation/<NNN>/`: exact prompt, generated protocol, and runtime metadata copied verbatim from immutable source generation `<NNN>`.
+- `speaker_identity_analysis.md`: conservative identity-evidence assessment.
+- `evaluation.md`: regression expectations and boundaries for evaluation.
+- `manifest.json`: source paths and SHA-256 provenance.
+
+No audio, raw model response, container logs, package-install logs, or unrelated run data is copied. The audio reference and its hash are in the manifest.
+
+## Evaluation role
+
+The exact compact diarized protocol input is the evidence source. The mapped generation is a valuable reference protocol, but it is not a gold standard for every wording choice. Operator feedback says later human editing was primarily editorial selection rather than factual correction; that feedback is not a persisted source artifact and must not be converted into unverified factual claims or expected wording.