test-driver/research/hypotheses/H-001-semantic-action-stability.md

42 lines
1.2 KiB
Markdown
Raw Normal View History

---
id: H-001
title: Semantic Action Stability
status: PROPOSED
created: "2026-08-22"
experiments: [E-001]
concepts: [C-semantic-action]
---
# H-001 — Semantic Action Stability
## Claim
A semantic action survives implementation restructuring better than a recorded UI
interaction sequence.
## Falsification condition
Across the labelled mechanical mutations in the lab (T05), a recorded interaction
sequence survives **at least as many** mutations as the semantic action does.
If mechanics-free identity buys no measurable durability, the central abstraction
is decorative and `SemanticAction` should be reduced to a naming convention.
## Measurement
Mechanical Recovery Rate for each of two arms over the same mutation set:
- **arm A** — semantic action realized by an agentic driver;
- **arm B** — a recorded selector-based sequence captured against the baseline.
Arm B is a genuine control and must be run, not assumed to fail.
## Threats to validity
The comparison is unfair if arm B is built naively — a brittle straw man makes
H-001 trivially true and worthless. Arm B uses the most robust selector strategy
reasonably available (roles, labels, test ids where the lab provides them).
## Status log
- 2026-08-22 `PROPOSED`. No evidence.