Implement Semantic Consolidator V0
- add deterministic canonicalization support for extraction items - add facts-only semantic consolidation using local Ollama - preserve source evidence and validate complete fact coverage - add conservative merge rules and non-LLM tests - record the first validated real-life consolidation benchmark - document current scope, limitations and next evaluation step
This commit is contained in:
@@ -195,12 +195,14 @@ Deterministic Canonicalizer:
|
||||
Semantic Consolidator:
|
||||
|
||||
- uses the local LLM
|
||||
- merges semantically equivalent statements
|
||||
- groups content by topic
|
||||
- preserves evidence from all contributing chunks
|
||||
- marks contradictions and uncertainty
|
||||
- separates durable information from transient discussion
|
||||
- produces Canonical Meeting Knowledge
|
||||
- V0 is implemented for facts-only semantic duplicate detection
|
||||
- V0 merges semantically equivalent fact items conservatively
|
||||
- V0 preserves source references and evidence
|
||||
- V0 validates that every source fact appears exactly once
|
||||
- V0 does not process non-fact categories semantically
|
||||
- later versions should group content by topic, mark contradictions and
|
||||
uncertainty, separate durable information from transient discussion and
|
||||
prepare Canonical Meeting Knowledge
|
||||
- does not directly write a protocol
|
||||
|
||||
---
|
||||
@@ -267,6 +269,7 @@ Implemented:
|
||||
- Transcript normalization
|
||||
- Technical chunk generation
|
||||
- Experimental LLM-based information extraction
|
||||
- Canonicalizer V1 deterministic extraction canonicalization
|
||||
|
||||
The current extraction step still performs multiple tasks simultaneously.
|
||||
|
||||
|
||||
Reference in New Issue
Block a user