test-driver/research/experiments/E-002-crystallization-fidelity.md
tegwick eee7722714 T09: crystallization
A stable agentic realization becomes deterministic code. All four exit
criteria met; 163 tests pass.

- crystallization.py: trajectory capture, stability assessment requiring the
  same path across several runs, CrystallizedDriver, pytest codegen
- crystallized/test_grant_access.py: generated, runs with no model, carries
  its lineage in the docstring
- descendant preserves the ancestor's oracle set, agrees with it across five
  lab versions, and still catches a seeded defect
- reversibility shown both ways via new M24 (grant endpoint renamed): the
  frozen descendant fails loudly rather than searching, and the agentic
  ancestor recovers from the same mutation

F-0007 (open): the 54% cost reduction must not be quoted in support of the
thesis. The T07 runtime is token-free, so the measured saving is one page
fetch, one parse and a two-candidate scoring pass. The saving the concept
actually claims - tokens, latency, retry variance - is unmeasured. Together
with F-0005 this makes a bounded live-model experiment the highest-value next
investment.

Assertions in the generated test are imported rather than restated, so it is
not fully standalone. Deliberate: paraphrased claims would be a second
unverified statement of intent.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

Assistant: claude-code
Assistant-Model: opus
Assistant-Process: 1629012@bnt-lap001
Assistant-Session: 78d4fb13-8a1e-474b-87a3-9b9261c49a39
2026-08-23 00:21:48 +02:00

1 KiB

id title status hypotheses task created
E-002 Crystallization fidelity and cost PLANNED
H-003
TD-WP-0002-T09 2026-08-22

E-002 — Crystallization fidelity and cost

Design

Run one agentic realization repeatedly against a stable lab version until realization is stable, crystallize it, then execute the descendant with no model involvement across every lab version the ancestor was run against.

Outcomes recorded

Oracle set of descendant vs ancestor · verdict agreement per lab version · execution cost ratio (tokens, wall time) · whether human authorship of assertions was required.

Decision rules

  • Descendant oracle set is not a superset of the ancestor's → H-003 falsified.
  • Any verdict disagreement on the same lab version → H-003 falsified.
  • Cost ratio ≥ 1 → thesis intact, product rationale is not. Record plainly rather than quietly.

Status

EXECUTED 2026-08-23 (T09). Fidelity criteria met across five lab versions; the cost criterion is met but uninformative — F-0007.