STATE-WP-0073: meter delta zero, remote audit, k8s prompt rollout evidence
Post-0072 8h capture shows zero legacy REST calls on hot keys. Document remote sweep, railiance01 ConfigMap rollout, and gitea-remote sync blocker.
This commit is contained in:
parent
8b6b28f220
commit
a46d5aa2f5
3 changed files with 618 additions and 123 deletions
155
workplans/STATE-WP-0073-legacy-meter-decline-and-remote-audit.md
Normal file
155
workplans/STATE-WP-0073-legacy-meter-decline-and-remote-audit.md
Normal file
|
|
@ -0,0 +1,155 @@
|
|||
---
|
||||
id: STATE-WP-0073
|
||||
type: workplan
|
||||
title: "Legacy-meter decline monitoring and remote caller audit"
|
||||
domain: infotech
|
||||
repo: state-hub
|
||||
status: active
|
||||
owner: codex
|
||||
topic_slug: custodian
|
||||
planning_priority: high
|
||||
planning_order: 73
|
||||
created: "2026-07-09"
|
||||
updated: "2026-07-09"
|
||||
state_hub_workstream_id: "44e2e123-9934-4b5e-8b50-1bac548c5b70"
|
||||
---
|
||||
|
||||
# STATE-WP-0073 — Legacy-meter decline monitoring and remote caller audit
|
||||
|
||||
**Parent:** `STATE-WP-0070` T02 (phase-2 legacy retirement).
|
||||
|
||||
**Prerequisite:** `STATE-WP-0072` finished — local caller remediation across five
|
||||
repos; railiance01 baseline deploy via `STATE-WP-0071`.
|
||||
|
||||
**Baseline evidence:** `docs/evidence/legacy-meter-weekly-review-20260709.json`
|
||||
(8h window ending 2026-07-08T23:48Z).
|
||||
|
||||
## Goal
|
||||
|
||||
Drive legacy-meter `GET /workstreams/*` counts down by ensuring all remote
|
||||
fix-consistency hosts and activity-core k8s projections run post-0072 code,
|
||||
then re-capture 8h windows until retirement candidates clear the seven-window
|
||||
gate for `STATE-WP-0070` T02 410 retirements.
|
||||
|
||||
## Context
|
||||
|
||||
Post-0072 8h baseline still shows heavy `unknown`-attributed traffic:
|
||||
|
||||
| Calls (8h) | Key |
|
||||
| ---: | --- |
|
||||
| 7,653 | `GET /workstreams/{workstream_id}` |
|
||||
| 3,892 | `GET /workstreams/{id}/dependencies/` |
|
||||
| 1,752 | `GET /workstreams/` |
|
||||
| 577 | `GET /tasks/?workstream_id` |
|
||||
|
||||
Likely sources: remote fix-consistency runners on old `state-hub`, activity-core
|
||||
k8s prompt projection not rolled, external clients without `X-StateHub-Component`.
|
||||
|
||||
Progress 2026-07-09: post-0072 8h capture shows **zero** legacy REST calls on all
|
||||
hot keys; delta in `docs/evidence/legacy-meter-delta-20260709.md`. Remote sweep
|
||||
exit 0; k8s ConfigMap updated on railiance01. **gitea-remote** push blocked —
|
||||
hosts should track `forgejo-remote` until mirror sync.
|
||||
|
||||
## Task: Fresh meter baseline and monitoring cadence
|
||||
|
||||
```task
|
||||
id: STATE-WP-0073-T01
|
||||
status: done
|
||||
priority: high
|
||||
state_hub_task_id: "6893c8aa-cc7e-4adc-bef6-cf644f2c2f66"
|
||||
```
|
||||
|
||||
1. Capture post-0072 8h review:
|
||||
`python scripts/capture_legacy_meter_evidence.py`
|
||||
2. Write dated evidence under `docs/evidence/legacy-meter-weekly-review-YYYYMMDD.json`.
|
||||
3. Compare window counts vs 20260709 baseline; note component attribution deltas.
|
||||
4. Schedule repeat captures (2–3× daily) until `GET /workstreams/*` declines or
|
||||
attribution names remaining callers.
|
||||
|
||||
Done when at least one post-0072 capture is committed with a delta summary in
|
||||
`docs/evidence/`.
|
||||
|
||||
## Task: Remote fix-consistency host audit
|
||||
|
||||
```task
|
||||
id: STATE-WP-0073-T02
|
||||
status: done
|
||||
priority: high
|
||||
state_hub_task_id: "2f53ce3f-3229-454f-ac54-42b0165d8b04"
|
||||
```
|
||||
|
||||
1. `bridge status` — tunnels connected (`state-hub-railiance01`, MCP paths).
|
||||
2. WSL `state-hub` ≥ `f120c04`; hub API healthy.
|
||||
3. Run `statehub fix-consistency --all --remote --api-base http://127.0.0.1:8000`
|
||||
(or `POST /consistency/sweep/remote-all`).
|
||||
4. Record per-host `state-hub` / `activity-core` SHAs and sweep exit codes.
|
||||
5. Fix stale hosts (git pull, permissions, image rollout) per
|
||||
`docs/evidence/railiance01-state-hub-deploy-20260709.md`.
|
||||
|
||||
Target commits:
|
||||
|
||||
| Repo | Minimum |
|
||||
| --- | --- |
|
||||
| `state-hub` | `f120c04` |
|
||||
| `activity-core` | `b59bf92` |
|
||||
| `the-custodian` | `6d10190` |
|
||||
|
||||
Done when remote sweep passes and meter shows `state-hub.fix-consistency`
|
||||
attribution without unexplained `unknown` bulk on GET routes.
|
||||
|
||||
## Task: activity-core k8s prompt rollout
|
||||
|
||||
```task
|
||||
id: STATE-WP-0073-T03
|
||||
status: done
|
||||
priority: high
|
||||
state_hub_task_id: "8ede25cd-c393-449d-98a6-1cd9456c8a12"
|
||||
```
|
||||
|
||||
Roll `activity-core/k8s/railiance/21-custodian-runtime.yaml` on railiance01 so
|
||||
cluster-projected daily triage prompt uses `/workplans/index` and `?workplan_id=`
|
||||
(not legacy `/workstreams/workplan-index`).
|
||||
|
||||
1. Verify manifest matches `the-custodian/runtime/prompts/daily_statehub_wsgi_triage.md`.
|
||||
2. Apply k8s rollout on railiance01; confirm pod restart healthy.
|
||||
3. Capture evidence (pod age, image tag, prompt checksum).
|
||||
|
||||
Done when railiance01 custodian-runtime pods project post-0072 prompt text.
|
||||
|
||||
## Task: Retire next meter-cleared REST key (T02 handoff)
|
||||
|
||||
```task
|
||||
id: STATE-WP-0073-T04
|
||||
status: wait
|
||||
priority: medium
|
||||
state_hub_task_id: "0a8effe8-3ac6-42d5-97ca-7cd830d2d555"
|
||||
```
|
||||
|
||||
When `POST /workstreams/{workstream_id}/dependencies/` shows **seven consecutive**
|
||||
8h zero-usage windows:
|
||||
|
||||
1. Return **410 Gone** (match `workplan-index` / `DELETE` pattern).
|
||||
2. Update tests and backlog checklist.
|
||||
3. Capture via `--retire-keys` on evidence script.
|
||||
|
||||
Blocked on meter gate — unblocks `STATE-WP-0070` T02.
|
||||
|
||||
## Task: Attribution sprint if meter flat
|
||||
|
||||
```task
|
||||
id: STATE-WP-0073-T05
|
||||
status: cancel
|
||||
priority: medium
|
||||
state_hub_task_id: "c8a80ffa-5076-484d-b86a-9bffc09889f7"
|
||||
```
|
||||
|
||||
Cancelled 2026-07-09: meter declined to zero on hot keys — attribution sprint not
|
||||
needed. Reopen if a later capture shows flat/high counts.
|
||||
|
||||
If post-audit 8h captures show no meaningful decline:
|
||||
|
||||
1. Fleet `rg` for `/workstreams` runtime callers (exclude workplans/tests).
|
||||
2. Add `X-StateHub-Component` to stragglers.
|
||||
3. Append findings to `research/YYYYMMDD-workstream-caller-sweep.md`.
|
||||
|
||||
Wait until T01/T02 captures complete; promote to `todo` if counts stay flat.
|
||||
Loading…
Add table
Add a link
Reference in a new issue