Lease-watch verdict must check what it claims
Version 3 reported 'survived past the lease TTL' after a clean 12-minute window on a 13-minute-old pod. Every measurement in it was accurate; the conclusion was not, because nothing checked that the observation window had actually exceeded the 30-minute lease it claimed to have outlasted. Fifth defect in this instrument, and the first to err toward reassurance. Versions 1 and 2 cried wolf, which provokes investigation. This one would have been believed, and readiness_state: verified recorded on it — the same way live-image-digest-match would have been believed. A check reporting success it has not established is indistinguishable from one that works, until it matters. The verdict now requires uptime > lease TTL and reports INCONCLUSIVE when a window is clean but too short. 'Clean' and 'proven' are different claims and only one of them was being measured. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Bjefh8NUiEiahN4JLwoSKM Assistant: claude-code Assistant-Model: opus Assistant-Process: 388925@bnt-lap001 Assistant-Session: 3507023f-e0fd-4a1e-9d90-a0d4217d1502
This commit is contained in:
parent
bd5ee3dfbb
commit
bdbef58259
8 changed files with 55 additions and 12 deletions
|
|
@ -55,8 +55,19 @@ esac
|
|||
SERVICE_SMOKE=${SERVICE_SMOKE:-$HOME/canned-prompts/service/tools/smoke.py}
|
||||
if [ -f "$SERVICE_SMOKE" ]; then
|
||||
echo "--- service-level (${SERVICE_SMOKE}) ---"
|
||||
# Wait for a ready endpoint before forwarding. Port-forwarding into a pod
|
||||
# that is still rolling reports "connection closed" for every service-level
|
||||
# check — a false failure that looks exactly like a broken service.
|
||||
for _ in $(seq 1 30); do
|
||||
[ "$(kubectl -n "$NS" get deploy canned-prompts -o jsonpath='{.status.readyReplicas}' 2>/dev/null)" = "1" ] && break
|
||||
sleep 2
|
||||
done
|
||||
kubectl -n "$NS" port-forward svc/canned-prompts 18000:8000 >/dev/null 2>&1 &
|
||||
PF=$!; trap 'kill $PF 2>/dev/null || true' EXIT; sleep 3
|
||||
PF=$!; trap 'kill $PF 2>/dev/null || true' EXIT
|
||||
for _ in $(seq 1 15); do
|
||||
curl -s -m 2 http://127.0.0.1:18000/healthz >/dev/null 2>&1 && break
|
||||
sleep 1
|
||||
done
|
||||
python3 "$SERVICE_SMOKE" --base http://127.0.0.1:18000 --expect-migration "${EXPECT_MIGRATION:-0002}" || FAILED=$((FAILED+1))
|
||||
else
|
||||
check "service-level-checks" "canned-prompts checkout not found at $SERVICE_SMOKE"
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue