Add collective commitment gold experiment
This commit is contained in:
@@ -1747,6 +1747,70 @@ additional semantic category is justified by this result.
|
||||
Artifacts are preserved under
|
||||
`artifacts/experiments/request_acceptance_gold_v0/20260820_qwen35_9b_single_run/`.
|
||||
|
||||
## EXP-0033 — Collective Commitment Gold V0
|
||||
|
||||
Status: Experimental; architecturally successful with one contained
|
||||
recognition false positive
|
||||
|
||||
Date: 2026-08-20
|
||||
|
||||
This isolated second-stage experiment tested whether an explicit collective
|
||||
first-person commitment can establish an action without inventing an individual
|
||||
owner. It used ten synthetic cases containing one minimal V3-style observation
|
||||
each. Evidence Observation V3 was neither called nor changed, and the accepted
|
||||
Request/Acceptance mechanism remained unchanged and independent.
|
||||
|
||||
The strict semantic schema contains exactly `observation_id`,
|
||||
`commitment_form` and `normalized_action_text`. `commitment_form` is closed to
|
||||
`individual_first_person`, `collective_first_person` and `none`. The model
|
||||
cannot output responsibility, ownership, requested actor, establishment,
|
||||
Action Item, protocol, confidence, relations, graphs, decisions or unresolved
|
||||
issues. Deterministic code validates schema and provenance, requires collective
|
||||
commitment plus non-empty action text, applies bounded deadline consistency and
|
||||
explicit-negation gates, and only then sets `status: established`,
|
||||
`commitment_scope: collective` and `responsible_person: null`.
|
||||
|
||||
Gold results:
|
||||
|
||||
- CC-01 explicit collective commitment: PASS; established, due `nächste
|
||||
Woche`, no person.
|
||||
- CC-02 individual commitment: PASS; correctly routed out of the collective
|
||||
path.
|
||||
- CC-03 tentative collective possibility: PASS; unestablished.
|
||||
- CC-04 collective suggestion: PASS; unestablished.
|
||||
- CC-05 impersonal necessity: PASS; unestablished.
|
||||
- CC-06 passive future statement: PASS; unestablished.
|
||||
- CC-07 collective rejection: PARTIAL. The model incorrectly returned
|
||||
`collective_first_person`, but the deterministic negation gate detected
|
||||
`nicht` and prevented establishment.
|
||||
- CC-08 qualified collective commitment: PASS; established with `nur im
|
||||
Technikum` preserved, null due and no person.
|
||||
- CC-09 collective commitment without deadline: PASS; established with null
|
||||
due and no person.
|
||||
- CC-10 speaker ownership trap: PASS; established collectively while Martin
|
||||
remained only the speaker and was not assigned ownership.
|
||||
|
||||
Configuration: exactly ten successful sequential `qwen3.5:9B` calls, one per
|
||||
case, temperature 0, `think=false`, `num_ctx=16384`, `num_predict=1024`, no
|
||||
retries, no voting and no prompt change. There were zero technical failed
|
||||
calls. Aggregate runner time was 10.504 seconds; summed per-call time was 10.500
|
||||
seconds, with 4,267 prompt-evaluation tokens and 415 evaluation tokens.
|
||||
|
||||
The outcome was nine PASS, one PARTIAL and zero FAIL. There was one recognition
|
||||
false positive and no recognition false negatives. No qualifier was lost, no
|
||||
individual owner was invented, and no responsibility or status field leaked
|
||||
into recognition. Bounded due handling preserved `nächste Woche` verbatim and
|
||||
returned null when no deadline was present.
|
||||
|
||||
Conclusion: the collective-commitment path is architecturally successful for
|
||||
this narrow Gold set. The deterministic negation gate contained the only model
|
||||
error, and every successful collective result necessarily retained
|
||||
`responsible_person: null`. This does not justify a generic commitment system,
|
||||
production integration, group identity inference or another semantic category.
|
||||
|
||||
Artifacts are preserved under
|
||||
`artifacts/experiments/collective_commitment_gold_v0/20260820_qwen35_9b_single_run/`.
|
||||
|
||||
## EXP-0026 — Topic-oriented Discussion Subject reconstruction V2 prototype
|
||||
|
||||
Date: 2026-08-11
|
||||
|
||||
Reference in New Issue
Block a user