Document target normalization V0 experiment

This commit is contained in:
2026-08-20 14:29:53 +02:00
parent 7fa771a7e4
commit 3918c0b1c4
5 changed files with 197 additions and 0 deletions
+49
View File
@@ -2138,6 +2138,55 @@ normalization, but not deriving rejection or integrating a new pipeline.
Artifacts are preserved under
`artifacts/experiments/target_resolution_v1_diagnostic/20260820_qwen35_9b_single_run/`.
## EXP-0039 — Target Normalization V0
Status: Experimental; normalization improved but incomplete
Date: 2026-08-20
Target Resolution V1 established correct linkage for all four narrow cases and
eliminated structural ID failures with deterministic self-linkage, closed ID
lists, and true JSON Schemas. Its remaining failures were normalization-only.
This isolated follow-up therefore accepted candidate and target IDs as fixed
input and tested only reconstruction of the positive German action meaning. It
contains no target selection, Negative Act classification, eligibility logic,
rejection derivation, or production integration.
The strict output schema contained exactly `candidate_observation_id`,
`target_observation_id`, and `normalized_target_text`. Both IDs were constrained
to their supplied values with JSON Schema `const`; normalized text was a
non-empty string and null was disallowed. The one fixed prompt required removal
of negative polarity, preservation of action, continuation, material scope and
source language, and exclusion of separate alternatives.
| Case | Actual normalized target | Verdict |
| --- | --- | --- |
| TN-01 | `Mit Dr. Schlummer zusammenarbeiten` | FAIL: positive polarity and collaboration survived, but continuation was lost |
| TN-02 | `externe Lösung weiterverfolgen` | PASS |
| TN-03 | `reale Anlage für den Druckversuch nutzen` | PASS |
| TN-04 | `Versuch in der realen Anlage durchführen` | PASS; Technikum alternative excluded |
Result: three PASS, zero PARTIAL, one FAIL. All four outputs passed strict
schema validation and copied both fixed IDs exactly, so changed-ID count was
zero. Polarity-error count was zero: even TN-01 removed rejection and negation.
Action/continuation-loss count was one (TN-01); material purpose/location
scope-loss count was zero; alternative-absorption count was zero. There was no
unsupported strengthening or normative leakage.
Configuration: exactly four `qwen3.5:9B` calls, temperature 0,
`think=false`, true JSON Schema, `num_ctx=16384`, `num_predict=1024`, no
retries, voting, or prompt tuning. Aggregate runner time was 5.066 seconds.
Conclusion: isolating normalization solved the polarity and scoped-action
failures seen in Target Resolution V1 for three of four cases, including exact
pressure-test scope and alternative isolation. Continuation semantics remain
unreliable in the self-contained collaboration case, so Target Normalization
V0 does not meet its full acceptance criterion. The result does not justify
rejection derivation or production integration.
Artifacts are preserved under
`artifacts/experiments/target_normalization_v0/20260820_qwen35_9b_single_run/`.
## EXP-0026 — Topic-oriented Discussion Subject reconstruction V2 prototype
Date: 2026-08-11