test-driver/research/experiments/E-002-crystallization-fidelity.md
tegwick eee7722714 T09: crystallization
A stable agentic realization becomes deterministic code. All four exit
criteria met; 163 tests pass.

- crystallization.py: trajectory capture, stability assessment requiring the
  same path across several runs, CrystallizedDriver, pytest codegen
- crystallized/test_grant_access.py: generated, runs with no model, carries
  its lineage in the docstring
- descendant preserves the ancestor's oracle set, agrees with it across five
  lab versions, and still catches a seeded defect
- reversibility shown both ways via new M24 (grant endpoint renamed): the
  frozen descendant fails loudly rather than searching, and the agentic
  ancestor recovers from the same mutation

F-0007 (open): the 54% cost reduction must not be quoted in support of the
thesis. The T07 runtime is token-free, so the measured saving is one page
fetch, one parse and a two-candidate scoring pass. The saving the concept
actually claims - tokens, latency, retry variance - is unmeasured. Together
with F-0005 this makes a bounded live-model experiment the highest-value next
investment.

Assertions in the generated test are imported rather than restated, so it is
not fully standalone. Deliberate: paraphrased claims would be a second
unverified statement of intent.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

Assistant: claude-code
Assistant-Model: opus
Assistant-Process: 1629012@bnt-lap001
Assistant-Session: 78d4fb13-8a1e-474b-87a3-9b9261c49a39
2026-08-23 00:21:48 +02:00

34 lines
1 KiB
Markdown

---
id: E-002
title: Crystallization fidelity and cost
status: PLANNED
hypotheses: [H-003]
task: TD-WP-0002-T09
created: "2026-08-22"
---
# E-002 — Crystallization fidelity and cost
## Design
Run one agentic realization repeatedly against a stable lab version until
realization is stable, crystallize it, then execute the descendant with no model
involvement across every lab version the ancestor was run against.
## Outcomes recorded
Oracle set of descendant vs ancestor · verdict agreement per lab version ·
execution cost ratio (tokens, wall time) · whether human authorship of assertions
was required.
## Decision rules
- Descendant oracle set is not a superset of the ancestor's → H-003 falsified.
- Any verdict disagreement on the same lab version → H-003 falsified.
- Cost ratio ≥ 1 → thesis intact, product rationale is not. Record plainly rather
than quietly.
## Status
`EXECUTED` 2026-08-23 (T09). Fidelity criteria met across five lab versions;
the cost criterion is met but uninformative — F-0007.