test-driver/research/hypotheses/H-003-crystallization.md

44 lines
1.2 KiB
Markdown
Raw Normal View History

---
id: H-003
title: Crystallization
status: PROPOSED
created: "2026-08-22"
experiments: [E-002]
concepts: [C-crystallization]
---
# H-003 — Crystallization
## Claim
A sufficiently stable agentic execution can be converted into deterministic test
code without losing relevant oracle coverage.
## Falsification condition
Any of:
- the generated deterministic test cannot be produced without human authorship of
the assertions;
- it drops one or more oracles present in the agentic ancestor;
- it passes where the ancestor would have failed, or vice versa, on the same lab
version;
- it costs no less to execute than the agentic ancestor.
## Measurement
- Crystallization success rate.
- Oracle set of descendant vs ancestor — must be a superset or equal.
- Verdict agreement between ancestor and descendant across lab versions.
- Execution cost ratio (tokens, wall time) descendant : ancestor.
## Note on the cost criterion
The cost criterion is included deliberately. If crystallization preserves
semantics but saves nothing, the thesis is intact but the product rationale is
not — and that distinction should be visible in the record rather than discovered
by a user.
## Status log
- 2026-08-22 `PROPOSED`. No evidence.