test-driver/research/experiments/E-001-mechanical-vs-defect.md

39 lines
1.2 KiB
Markdown
Raw Normal View History

---
id: E-001
title: Mechanical recovery and defect discrimination over the labelled mutation set
status: PLANNED
hypotheses: [H-001, H-002, H-004]
task: TD-WP-0002-T08
created: "2026-08-22"
---
# E-001 — Mechanical recovery and defect discrimination
## Design
Run the same verification asset against every labelled lab mutation (T05),
in two arms:
- **arm A** — semantic action realized by the agentic driver;
- **arm B** — a recorded selector-based sequence captured against the baseline,
built with the most robust selector strategy reasonably available.
Arm B is the control for H-001 and must actually be run.
## Outcomes recorded per run
surface diff (S1) · postcondition met and surface used (S2) · oracle verdicts
(S3) · classification emitted · claim/invariant diff (expected empty) ·
tokens · wall time · retries.
## Decision rules
- **False Adaptation Rate > 0** → stop. H-004 falsified; redesign, do not tune.
- Arm B recovery ≥ arm A recovery → H-001 falsified.
- Recovery achieved with a non-empty claim diff → H-002 falsified *and* a
framework defect, since D-02 forbids the write path.
## Status
`PLANNED`. Blocked on T05 (lab) and T07 (agentic driver).