clay-borg/research
tegwick a86efba4c3 CB-WP-0022-T01: survey — how rule systems record the ambiguity they find
CB-RES-0007 plus a runnable baseline harness. Tier L invokes the
runnable-baseline option; the external candidates are practices rather
than software, so their rows are directional and cap at parity, and the
row that CAN be run is our own.

Measured: 6 findings across 11 files with no index, 2 of 6 (33%) with a
runnable reproduction, U1-U10 raised 2026-07-30 and first READ
2026-08-03 -- 4 days, 0 of 10 ruled.

The uncomfortable number is stated before the review can find it: the
proposed 'no finding without its reproduction' rule would reject four of
our six existing findings. The survey answers rather than routes around
it -- none of the four is expensive to reproduce, so 33% is evidence
nobody was ever asked for one.

Magic corrected an assumption this pass was about to build on. Rulings
are NOT authoritative -- they are 'reminder information with no actual
weight or rules meaning' -- and the authoritative fix folds into the
Oracle card text. So a finding closes when the SOURCE changes, not when
an annotation is added, and the register must be a queue that empties
rather than an archive that grows. That is now a constraint on the ADR's
lifecycle.

Model checkers supply the reproduction rule independently: a
counterexample trace IS the finding. W3C's implementation-defined mark is
the machinery we already have in provisional: scenarios and must reuse.

The loop-lint gate caught the new tool with no --self-test; it has one,
pinning the 2-of-6 baseline so a later edit cannot move it silently.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-03 21:19:12 +02:00
..
CB-RES-0001-harness/boardgame-io T04: adversarial review round + survey corrections + ADR-0002 (reimplement, assimilate patterns) 2026-07-31 01:25:02 +02:00
CB-RES-0001-game-kernel.md T04: adversarial review round + survey corrections + ADR-0002 (reimplement, assimilate patterns) 2026-07-31 01:25:02 +02:00
CB-RES-0002-cost-accounting.md T06: wire cost into the loop 2026-07-31 08:52:33 +02:00
CB-RES-0003-agent-vs-deterministic.md CB-RES-0003 + CB-WP-0004: 38% of pass cost is mechanical turns 2026-07-31 09:49:57 +02:00
CB-RES-0004-replay-and-kernel-coverage.md CB-RES-0004: the instruments count names, not assertions 2026-07-31 14:19:30 +02:00
CB-RES-0005-session-shape.md CB-RES-0005 + CB-WP-0007: session shape measures the wrong window 2026-08-01 13:49:19 +02:00
CB-RES-0006-render-port.md CB-WP-0012-T04: cb-render-html — stage 1 draws, and the browser is the toolkit 2026-08-02 04:27:25 +02:00
CB-RES-0007-design-instrument.md CB-WP-0022-T01: survey — how rule systems record the ambiguity they find 2026-08-03 21:19:12 +02:00