Implement Semantic Consolidator V0

- add deterministic canonicalization support for extraction items
- add facts-only semantic consolidation using local Ollama
- preserve source evidence and validate complete fact coverage
- add conservative merge rules and non-LLM tests
- record the first validated real-life consolidation benchmark
- document current scope, limitations and next evaluation step
This commit is contained in:
2026-07-31 11:25:46 +02:00
parent 6e34334506
commit 90aa34d5d0
20 changed files with 5517 additions and 93 deletions
+9 -6
View File
@@ -195,12 +195,14 @@ Deterministic Canonicalizer:
Semantic Consolidator:
- uses the local LLM
- merges semantically equivalent statements
- groups content by topic
- preserves evidence from all contributing chunks
- marks contradictions and uncertainty
- separates durable information from transient discussion
- produces Canonical Meeting Knowledge
- V0 is implemented for facts-only semantic duplicate detection
- V0 merges semantically equivalent fact items conservatively
- V0 preserves source references and evidence
- V0 validates that every source fact appears exactly once
- V0 does not process non-fact categories semantically
- later versions should group content by topic, mark contradictions and
uncertainty, separate durable information from transient discussion and
prepare Canonical Meeting Knowledge
- does not directly write a protocol
---
@@ -267,6 +269,7 @@ Implemented:
- Transcript normalization
- Technical chunk generation
- Experimental LLM-based information extraction
- Canonicalizer V1 deterministic extraction canonicalization
The current extraction step still performs multiple tasks simultaneously.