coulomb/clay-borg
4
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

T05: CB-EV-0002 — all 9 metrics met, and /compact measured at 3.1x

Browse source 
AC-1 $93.32 ($92.21 main + $1.11 subagent), residual $0.000000. No
unmeasured rows. Composition: 88.0% cache, 11.9% output, 249:1 context
re-read to text written.

The question that could not be answered before: what /compact costs.
The transcript records it directly — 542,991 -> 19,974 tokens, a 27x
reduction. Cost per turn fell from $0.457 (136 turns before) to $0.149
(202 turns after). The 202 post-compact turns cost less than half the
136 before them.

This qualifies CB-WP-0003 T04: sessions are bounded-quadratic, not
quadratic. Cost grows with context between compactions and resets at
each one, so the failure mode is a long UNCOMPACTED session. Whether a
fresh session beats a compaction is now measurable, and T04 should
measure it before prescribing one task per session.

Stale $0.66/$92.87 targets updated across survey and workplan.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
tegwick 2026-07-31 08:51:50 +02:00
parent e008b1e787
commit c0eef604e8
4 changed files with 167 additions and 10 deletions
Download patch file Download diff file Expand all files Collapse all files

10
workplans/CB-WP-0002-cost-accounting.md
View file

@ -40,8 +40,8 @@ repeatable acceptance target:
| Cache write (1h) | 1,672,854 | $21.95 |
| Input | 676 | $0.00 |
| Main transcript (339 responses: 213 opus-5, 118 fable-5, 14 sonnet-5) | | $92.21 |
| Subagent tree (adversarial review, ran inside the pin) | | $0.66 |
| **TRUE TOTAL** | | **$92.87** |
| Subagent tree (adversarial review, ran inside the pin) | | $1.11 |
| **TRUE TOTAL** | | **$93.32** |
The headline finding survives the correction and gets sharper:
**88.4% of the cost is cache, against 314k tokens of output — a 256:1
@ -162,15 +162,15 @@ each message at its own model's rate.
```task
id: CB-WP-0002-T05
status: todo
status: done
priority: medium
state_hub_task_id: "bea4cc0a-e4d0-4077-9dc7-df7726a48f86"
```
Run the collector over the CB-WP-0001 session and commit
`evidence/CB-EV-0002-cost-accounting.md`. The acceptance test is
`specs/CostAccounting.md` AC-1: reproduce **$92.87 pinned at `fc76445`,
as its two components** ($92.21 main transcript + $0.66 subagent tree),
`specs/CostAccounting.md` AC-1: reproduce **$93.32 pinned at `fc76445`,
as its two components** ($92.21 main transcript + $1.11 subagent tree),
plus AC-2's zero reconciliation residual.
*(Originally written as "must reproduce $248.46". That figure was wrong