clay-borg/evidence/CB-EV-0024-could-we-have-won.md
tegwick a9978c7a91
Some checks failed
ci / check (push) Failing after 4s
ADR-0017: window 2's verdict — the mechanism worked, my account of it did
not

Tier M (changes how the loop constrains its own operation), declared at
d8 because the rate for window 3 is what this document decides and
declaring at a rate it invents would be circular. chaos d8 = 7, no
override.

I CLAIMED WINDOW 2 PRODUCED ZERO OVERRIDES, FIVE TIMES, AND IT IS FALSE.
Declaration 3 (CB-WP-0020) rolled d8 = 8, overrode, drew S against a
structural S, and changed nothing -- and CB-WP-0020 recorded it correctly
at the time, in those words: "the first override at d8... It changed
nothing... One."

Counting the workplans takes one command and I never ran it. CB-EV-0024
asserted "zero" without checking; CB-EV-0025, 0026, 0027 and CB-WP-0029
each cited the one before. A claim propagated five times by citation
rather than by measurement, in files whose subject was that exact failure.
facts-check catches a copied number that disagrees with its source;
nothing catches a number with NO source, asserted once and repeated.
Registered F23, and all four evidence files carry an in-place correction
rather than a silent edit (ADR-0012 D5).

THE ACTUAL VERDICT: THE RATE IS WORKING. Eleven rolls at d8 -- declaration
1 opened the window at the old d4 -- against 1.375 eights expected, 1
observed. Not a shortage of evidence; the design.

BUT THE RETIREMENT CONDITION GENUINELY CANNOT FIRE, and that took
computing to see. "An override changes nothing twice running" needs a
consecutive pair at P=1/3 each, so ~12 overrides expected, at ~1.4 per
window: ~9 windows, roughly 100 declarations. A gate that cannot cash out
on any realistic horizon is decoration, which ADR-0006 D3 forbids.

Restated to be evaluated PER WINDOW: retire if a full window's overrides
all change nothing, met in two consecutive windows. A window with no
overrides is inconclusive and advances nothing. ~24 declarations rather
than ~100. Window 2 counts as the first; window 3 opens at d8 and decides.

Recorded and deliberately not acted on: declarations 5-9 rolled six five
times running, ~1 in 370 for some run of five in eleven rolls. shuf tested
over 200 rapid successive calls looks uniform, longest run three. Found
post hoc, which is how coincidences become findings, so it is logged for a
future window to check rather than treated as evidence.

InnerLoop.md then crossed the loadability limit, and so did
InnerLoopReference.md. The window log moved to specs/ChaosRollHistory.md:
it grows by one entry per window, and a log inside a reference eventually
crowds out the reference.

make all: exit 0.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-07 10:55:54 +02:00

7.9 KiB
Raw Blame History

CB-EV-0024 — could we have won

CB-WP-0025 T07. Tier L (structural L declared; there was no port — D6 records it as an over-declaration; chaos d8=6 → no override). Declaration 8 of chaos window 2. Closed 2026-08-05.

Delivered: CB-RES-0008 with a runnable baseline, an adversarial review that withdrew its headline, ADR-0013, RetrospectiveAnalysis.md, games/ground/src/search.rs, benches/search.rs, examples/difficulty.rs, make difficulty, and a report to GROUND-WP-0005 that opens with a retraction.


1. Was the maintainer's game winnable?

The question the pass exists for. Yes, and the tool answers it.

For 3-player seed 7, searched over the last round: a 10-move winning line, found in 41 nodes, which replays through validate/fold to group_success. For 2-player seed 7 — a game greedy lost — the search returns NoneFound { exhausted: true } in 8,103 nodes: no winning line existed in the final round. That is a real negative, not a budget cut, and the type keeps the two apart.

The feature works. The difficulty half is where the trouble was.

2. What the review cost against what it caught

Second tier-L review in this project, second time it caught a false headline that every automated gate passed. make all was green throughout.

caught by
the headline finding was about GreedyPolicy, not GROUND (C4) only the review
the node cost was 3050× too high (C1) only the review
exhaustive search is not out (C6) only the review
the finding failed our own admissibility rule (C3) only the review
the maintainer's losses were misattributed (C5) only the review
the benchmark's fixture timed an empty Vec building it
the traversal skipped later seats; the rewind was off a round building it
K=2 is not exhaustible at two seats running it
the winnable fraction is still greedy-conditioned writing it down

Five of nine from the review, four from execution. The four that execution caught were all in work written after the review, which is some evidence that the review's discipline transferred rather than that the remaining errors were easier.

The reviewer under-ranked their own best challenge. They put C4 fourth. Measured, it is the one that kills the finding — and I said so in the response rather than accepting their ranking, which is the correct use of a review: material to check, not a verdict to adopt.

3. The error family, now with five instances

CB-EV-0019 §1 named it: this project's arithmetic errors are not in the arithmetic. A number computed correctly against the wrong base, span, or subject.

# pass the wrong thing
1 CB-WP-0021 csv cost against AM-4a, which never sees the code
2 ground-game report "12 in the file" — a sum with no deal table
3 CB-WP-0018 SOLVE's inertness attributed to the wrong condition
4 this pass, C1 a timer bracketing whole games, divided by decisions
5 this pass, C4 a win rate attributed to the game, not the policy

And two projections published in place of measurements, both in this pass: the survey's 7.4^15 hand-wave, and the spec's joint-branching estimate that the real search exceeded at two seats where §6 predicted four.

facts-check catches copies that disagree. Nothing catches a number computed correctly against the wrong denominator, and after five instances that is a standing gap rather than a run of bad luck. Naming it is what this file can do; closing it is not this pass's.

4. What the difficulty measurement actually shows

make difficulty, 60 seeds:

seats winnable greedy random first-legal spread
2 60% 60.0% 5.0% 76.7% 71.7
3 93% 88.3% 6.7% 25.0% 81.7
4 100% 93.3% 6.7% 30.0% 86.7
5 100% 100.0% 3.3% 0.0% 100.0
6 100% 100.0% 3.3% 0.0% 100.0

The spread column is the finding. 71.7 to 100.0 points between three trivial policies. It is the evidence for the prohibition in RetrospectiveAnalysis §4.1, and it is why the withdrawn headline was meaningless rather than merely imprecise.

The 56 seat rows point the opposite way from the withdrawn claim. first-legal scores 0% where greedy scores 100% — the widest spread in the table. Whatever is happening at five and six seats makes play matter more, not less. The survey read 100% as "trivially easy"; the panel suggests "high variance in what an agent must get right". Neither is established, and saying so is the honest state.

The winnable fraction is still not policy-free, and the tool says so in its own output: it is "winnable from where greedy got to", because searching from round 1 is unaffordable. Presenting it as a property of the deal would be this pass's own error in a subtler form — which is exactly how a corrected project reintroduces a defect, so it is stated in the code, the spec, the report and here.

5. Tier L's cost, and the over-declaration

The tier was declared L on the assumption of a new capability port. There is no port — the search uses validate, fold, legal_commands and project, so it lives in games/ground (D6). By the structural trigger this was an M.

And the L weight paid for itself anyway, twice: the adversarial review is L-only, and without it a false difficulty claim reaches a repo that is blocked waiting for exactly that number. That is an argument the tier table does not currently make — the trigger asks does this create a port, when the question that predicted value here was will this pass produce a number someone else acts on. Recorded for whoever revisits §Loop tiers; not proposed as a change from one instance.

6. Chaos window 2

CORRECTED 2026-08-07 — this section is wrong. Window 2 produced one override: declaration 3 (CB-WP-0020) rolled d8 = 8, drew S against a structural S, and changed nothing — which CB-WP-0020 recorded correctly at the time as "One." Eleven rolls at d8 (declaration 1 opened the window at d4) against an expectation of 1.375 eights. The rate was working; I asserted "zero" without counting, and each later evidence file cited the one before it. See ADR-0017 and F23.

Declaration 8 of 12. Structural L (over-declared), d8 = 6, no override.

Eleven declarations, no 8 rolled. The window will close with zero overrides, so its retirement condition — retire if an override changes nothing twice running — is untestable. Window 1 closed with two overrides at d4 and both changed the outcome.

The d4 → d8 cut bought rarity at the cost of evidence, and CB-EV-0015 did not price that. At d8 over twelve declarations the expected count is 1.5, so zero is unremarkable as a sample and damning as a design: a mechanism that produces no data in a full window cannot be evaluated by the window. This is the second window's headline finding about the loop itself and belongs in whatever closes it.

7. Cost

CB-WP-0024's cost, by re-running the instrument: make cost. Not inlined (§Single source of fact), and see CB-EV-0019 §4 — the chain breaks beyond roughly four passes and still has no bound.

Open after this pass

  • Search from round 1 would remove the greedy confound. Needs transposition or move-ordering; neither built.
  • Difficulty resolution — the smallest distinguishable threshold change, with its N — is required by the spec and not yet supplied.
  • The witness is not wired to the ending page. T05 built the search; the browser cannot yet ask it. That is the maintainer-facing half of remark 2 and it is not done.
  • The wrong-denominator family has no control (§3), at five instances.
  • The chaos window's retirement condition is untestable (§6).