clay-borg/history
tegwick 7b4d9e359f CB-WP-0004 T06: retrospective — what actually predicted the outcome
The question was whether converting agent work to deterministic tooling
recovers capacity or the work reappears elsewhere. Neither, cleanly:
tooling recovers capacity where it removes the possibility of doing the
work by hand, and recovers nothing where it merely offers a better
option.

Sorting the five candidates by that test reproduces the results exactly.
env-setup and task-done left no manual path — env-test fails the build if
the friction returns, and task-done refuses to emit an estimate, so the
old way means knowingly writing fiction. Both met. facts-check and
`make status` left grep and heredocs one keystroke away. Both missed.

This is the principle ADR-0003 already used to reject explicit session
markers — nothing that depends on discipline gets to be the primary
index. It governs tooling economics too, and CB-RES-0003 did not apply
it.

Stated confidence sorted the extremes and said nothing in the middle,
where every judgement call lives: both high met, both medium missed, and
the single low also met, so it was miscalibrated at that end too. Future
reviews state the mechanism instead — after this fix, is the manual path
impossible, absurd, or merely inferior? — and only the first two may
carry a cost prediction.

The confound is symmetric and does not explain the split: building
repo.py and task-done.py also required inspection and patching, and those
categories still went to zero. It inflates the size of the miss, not its
location.

The most valuable output is not the 6 points of 38 recovered. It is that
the loop made a falsifiable quantitative forecast, was wrong by 4-5x, and
could say exactly which parts were wrong and why.

CB-WP-0004 status -> done.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-07-31 10:28:35 +02:00
..
260730-InitialExploration.md Add INTENT.md and archive initial exploration notes 2026-07-30 23:55:43 +02:00
260731-cost-accounting-challenge.md T02 review round: survey approved after 15 of 16 findings conceded 2026-07-31 08:43:32 +02:00
260731-cost-accounting-research.md T01: cost-accounting survey — and a 2.7x correction to our own numbers 2026-07-31 04:27:52 +02:00
260731-cost-accounting-response.md T02 review round: survey approved after 15 of 16 findings conceded 2026-07-31 08:43:32 +02:00
260731-cost-accounting-retrospective.md T07: InnerLoop v1.1 — the instrument must emit its own target 2026-07-31 08:53:52 +02:00
260731-game-kernel-challenge.md T04: adversarial review round + survey corrections + ADR-0002 (reimplement, assimilate patterns) 2026-07-31 01:25:02 +02:00
260731-game-kernel-research.md T03: game-kernel SOTA survey with measured boardgame.io baseline harness 2026-07-31 01:11:04 +02:00
260731-game-kernel-response.md T04: adversarial review round + survey corrections + ADR-0002 (reimplement, assimilate patterns) 2026-07-31 01:25:02 +02:00
260731-inner-loop-retrospective.md T09: InnerLoop v1.0 — corrected from the first full pass 2026-07-31 03:11:19 +02:00
260731-inner-loop-rule-audit.md ADR-0004: ratify AM-4a and AM-4b (maintainer decision) 2026-07-31 09:45:35 +02:00
260731-loop-hardening-retrospective.md T10: InnerLoop v1.2 — hardening does not converge, so optimize correction 2026-07-31 09:31:19 +02:00
260731-mechanical-work-retrospective.md CB-WP-0004 T06: retrospective — what actually predicted the outcome 2026-07-31 10:28:35 +02:00