Document target normalization V0 experiment
This commit is contained in:
@@ -2138,6 +2138,55 @@ normalization, but not deriving rejection or integrating a new pipeline.
|
||||
Artifacts are preserved under
|
||||
`artifacts/experiments/target_resolution_v1_diagnostic/20260820_qwen35_9b_single_run/`.
|
||||
|
||||
## EXP-0039 — Target Normalization V0
|
||||
|
||||
Status: Experimental; normalization improved but incomplete
|
||||
|
||||
Date: 2026-08-20
|
||||
|
||||
Target Resolution V1 established correct linkage for all four narrow cases and
|
||||
eliminated structural ID failures with deterministic self-linkage, closed ID
|
||||
lists, and true JSON Schemas. Its remaining failures were normalization-only.
|
||||
This isolated follow-up therefore accepted candidate and target IDs as fixed
|
||||
input and tested only reconstruction of the positive German action meaning. It
|
||||
contains no target selection, Negative Act classification, eligibility logic,
|
||||
rejection derivation, or production integration.
|
||||
|
||||
The strict output schema contained exactly `candidate_observation_id`,
|
||||
`target_observation_id`, and `normalized_target_text`. Both IDs were constrained
|
||||
to their supplied values with JSON Schema `const`; normalized text was a
|
||||
non-empty string and null was disallowed. The one fixed prompt required removal
|
||||
of negative polarity, preservation of action, continuation, material scope and
|
||||
source language, and exclusion of separate alternatives.
|
||||
|
||||
| Case | Actual normalized target | Verdict |
|
||||
| --- | --- | --- |
|
||||
| TN-01 | `Mit Dr. Schlummer zusammenarbeiten` | FAIL: positive polarity and collaboration survived, but continuation was lost |
|
||||
| TN-02 | `externe Lösung weiterverfolgen` | PASS |
|
||||
| TN-03 | `reale Anlage für den Druckversuch nutzen` | PASS |
|
||||
| TN-04 | `Versuch in der realen Anlage durchführen` | PASS; Technikum alternative excluded |
|
||||
|
||||
Result: three PASS, zero PARTIAL, one FAIL. All four outputs passed strict
|
||||
schema validation and copied both fixed IDs exactly, so changed-ID count was
|
||||
zero. Polarity-error count was zero: even TN-01 removed rejection and negation.
|
||||
Action/continuation-loss count was one (TN-01); material purpose/location
|
||||
scope-loss count was zero; alternative-absorption count was zero. There was no
|
||||
unsupported strengthening or normative leakage.
|
||||
|
||||
Configuration: exactly four `qwen3.5:9B` calls, temperature 0,
|
||||
`think=false`, true JSON Schema, `num_ctx=16384`, `num_predict=1024`, no
|
||||
retries, voting, or prompt tuning. Aggregate runner time was 5.066 seconds.
|
||||
|
||||
Conclusion: isolating normalization solved the polarity and scoped-action
|
||||
failures seen in Target Resolution V1 for three of four cases, including exact
|
||||
pressure-test scope and alternative isolation. Continuation semantics remain
|
||||
unreliable in the self-contained collaboration case, so Target Normalization
|
||||
V0 does not meet its full acceptance criterion. The result does not justify
|
||||
rejection derivation or production integration.
|
||||
|
||||
Artifacts are preserved under
|
||||
`artifacts/experiments/target_normalization_v0/20260820_qwen35_9b_single_run/`.
|
||||
|
||||
## EXP-0026 — Topic-oriented Discussion Subject reconstruction V2 prototype
|
||||
|
||||
Date: 2026-08-11
|
||||
|
||||
Reference in New Issue
Block a user