Add negative act form experiment
This commit is contained in:
@@ -1890,6 +1890,78 @@ cross-pattern reconciliation is justified.
|
||||
Artifacts are preserved under
|
||||
`artifacts/experiments/explicit_rejection_gold_v0/20260820_qwen35_9b_single_run/`.
|
||||
|
||||
## EXP-0035 — Negative Act Form V0
|
||||
|
||||
Status: Experimental; successful for form classification with normalization
|
||||
limitations
|
||||
|
||||
Date: 2026-08-20
|
||||
|
||||
EXP-0034 failed because the binary `explicit_action_rejection | none` question
|
||||
collapsed materially different negative acts. It missed self-contained
|
||||
non-pursuit and promoted personal preference, recommendation and temporary
|
||||
non-action to rejection. This isolated follow-up tested only whether those
|
||||
evidence-near forms can be distinguished before any normative derivation. It
|
||||
does not derive rejection, decision, outcome, topic closure, responsibility or
|
||||
protocol status, and EXP-0034 remained unchanged.
|
||||
|
||||
The strict output schema contains exactly `observation_id`,
|
||||
`negative_act_form` and `normalized_action_text`. The closed form vocabulary is
|
||||
`explicit_non_pursuit`, `personal_preference`, `recommendation`,
|
||||
`temporary_non_action` and `none`. Non-`none` forms require non-empty normalized
|
||||
action text; `none` requires null. Rejection, status, decision, outcome,
|
||||
responsibility and other normative fields are forbidden recursively. Local
|
||||
context may resolve a candidate observation's pronoun, but the schema contains
|
||||
no target relation and the experiment exposes no derivation function.
|
||||
|
||||
Gold results:
|
||||
|
||||
- NA-01 explicit non-pursuit: PARTIAL. The form was correct; `working with Dr.
|
||||
Schlummer` omitted the continuation aspect from normalization.
|
||||
- NA-02 paraphrased explicit non-pursuit: PASS.
|
||||
- NA-03 personal preference: PARTIAL. The form was correct, but normalization
|
||||
repeated `Ich würde das nicht machen` instead of resolving the real-plant
|
||||
trial target.
|
||||
- NA-04 negative recommendation: PARTIAL. The form was correct; the normalized
|
||||
English action used the loose rendering `real asset` for `reale Anlage`.
|
||||
- NA-05 temporary non-action: PASS.
|
||||
- NA-06 concern only: PASS with `none` and null action text.
|
||||
- NA-07 uncertainty: PASS with `none` and null action text.
|
||||
- NA-08 factual negation: PASS with `none` and null action text.
|
||||
|
||||
Expected-versus-actual form confusion was entirely diagonal:
|
||||
|
||||
| Expected form | Actual form | Count |
|
||||
| --- | --- | ---: |
|
||||
| `explicit_non_pursuit` | `explicit_non_pursuit` | 2 |
|
||||
| `personal_preference` | `personal_preference` | 1 |
|
||||
| `recommendation` | `recommendation` | 1 |
|
||||
| `temporary_non_action` | `temporary_non_action` | 1 |
|
||||
| `none` | `none` | 3 |
|
||||
|
||||
Configuration: exactly eight successful sequential `qwen3.5:9B` calls, one
|
||||
per case, temperature 0, `think=false`, `num_ctx=16384`,
|
||||
`num_predict=1024`, no retries, no voting and no prompt changes. There were zero
|
||||
technical failures. Aggregate runner time was 8.688 seconds; summed per-call
|
||||
time was 8.686 seconds, with 4,183 prompt-evaluation tokens and 310 evaluation
|
||||
tokens.
|
||||
|
||||
The result was five PASS, three PARTIAL and zero FAIL. All eight
|
||||
`negative_act_form` classifications matched Gold. There was no unsupported
|
||||
semantic strengthening and no rejection, status, decision, outcome,
|
||||
responsibility or topic-closure leakage. Normalized action meaning was fully
|
||||
acceptable in five cases and imperfect in three.
|
||||
|
||||
Conclusion: the finer evidence-near form vocabulary successfully distinguished
|
||||
the four semantic boundaries that defeated the binary rejection experiment in
|
||||
this small Gold set. The result supports separating negative-act-form
|
||||
recognition from later normative derivation, but local target normalization is
|
||||
not yet uniformly reliable. It does not justify modifying EXP-0034, deriving
|
||||
rejection, production integration or beginning cross-pattern reconciliation.
|
||||
|
||||
Artifacts are preserved under
|
||||
`artifacts/experiments/negative_act_form_v0/20260820_qwen35_9b_single_run/`.
|
||||
|
||||
## EXP-0026 — Topic-oriented Discussion Subject reconstruction V2 prototype
|
||||
|
||||
Date: 2026-08-11
|
||||
|
||||
Reference in New Issue
Block a user