intelligence-radar/workplans/IR-WP-0004-evidence-coverage-and-field-calibration.md

id	type	title	domain	repo	status	flavor	owner	topic_slug	created	updated	state_hub_workstream_id
IR-WP-0004	workplan	Expand verified evidence and calibrate against field outcomes	infotech	intelligence-radar	finished	implementation	codex	custodian	2026-09-13	2026-09-14	9df17f9e-40b5-5df2-b3d2-a236d3915d71

Expand verified evidence and calibrate against field outcomes

Residual research and product scope from IR-WP-0003. v0.2 implements the mechanics; this work grows the evidence and operational reach without inventing calibration.

Build complete comparable profile evidence

id: IR-WP-0004-T01
status: cancel
priority: high
state_hub_task_id: "4f9538f6-3bf0-513f-baa0-5540430a2254"

Review exact versions, harnesses, effort and scores for five task-relevant instruments. Expand beyond the two-profile dated price comparison. Preserve conflicting results and independently verify requester access. Acceptance: at least two eligible profiles with complete comparable evidence and a source-backed Frontier/Efficient comparison. All other imported model/benchmark claims remain research leads until reviewed.

2026-09-13: Retained two additional source captures and a vendor-reported five-instrument transcription. Exact harness/effort differences remain explicit; these results do not establish comparable OpenRouter execution profiles. T01 acceptance remains open.

Collect representative real task outcomes

id: IR-WP-0004-T02
status: cancel
priority: high
state_hub_task_id: "50522d33-d3e4-5a5e-ab8c-397a38c1ab17"

Run an explicitly budgeted sample of representative tasks with retained verifier artifacts. Record successes and failures, actual cost and runtime. Evaluate selection bias and dependence before treating Wilson bounds as predictive. Develop versioned cross-task calibration and measured cost/runtime intervals only when justified.

2026-09-13: User authorized OpenRouter within USD 10. Implemented a serialized, append-only budgeted runner and 20 controlled cases across five families. The first request failed with HTTP 401; a read-only credential check also returns 401 after resumption. No completed trial or verified spend is recorded. Keep the USD 0.023712 reservation pending until billing is reconciled. Requires a valid OpenRouter credential delivered to the local environment. The discovered openrouter-llm-connect route is scoped to a separate service and is not a generic client credential. See docs/evidence/2026-09-13-resume.md.

2026-09-14 correction: User confirms an existing OpenBao key. The actual blocker is the admitted access contract, tracked in WARDEN-WP-0039-T03; the native replacement is waiting in SECRETS-WP-0007-T04/T07 and SECRETS-WP-0006-T05. Do not request another key. Concrete native repair and acceptance packet: OpenRouter access. The Bao key remains untested; no secret or policy changes were made.

Extend publication and hosted operation

id: IR-WP-0004-T03
status: cancel
priority: medium
state_hub_task_id: "e865449d-d53d-50bc-8983-2bd3605dfaee"

Add curated source adapters and editorial synthesis, artifact retention/export, reviewed source coverage, and a deployment-independent worker if continuous uptime is required. Add decomposition comparisons against measured monolithic outcomes. Keep draft creation separate from reviewed publication and any notifications.

2026-09-13: Portable recommendation export/import implemented with checksum, path, dependency and replay checks before publication. Default make lists targets. All 32 tests and repository/archive integrity checks pass. Curated publication, hosted workers and decomposition comparisons remain open.

Trial admission preparation — 2026-09-14

Owner work now lives in FLEX-WP-0026 and SECRETS-WP-0010-T03. The native contract, current PDP, Approval Engine deployment and scoped reader proof have progressed; real human approval and native OpenRouter delivery remain open. Sent readiness follow-up to secrets-engine. Added a no-network trials --plan with exact request identities, input hashes and campaign reservations; retained pilot/full review snapshots and source/input hash manifest. These are review inputs, not installation pins or delivery authorization. All 35 tests and repository integrity checks pass. T02 remains wait on native delivery and billing.

Native execution prerequisite — 2026-09-14

SECRETS-WP-0010-T03 now records all three real human approvals approved and unconsumed; scoped reader login succeeded. Nested administrator login and stable workstation time still prevent native execution. Do not repeat approvals. Read-only clock sampling found Linux unsynchronized (+3.58s NTP offset) and Windows 16.7–18.9s behind the guest. An operator-approved one-time Windows resync did not establish synchronization: Windows Time event 129 reports domain-peer discovery failure. The domain-joined host uses NT5DS; preserve that managed configuration. Restore domain connectivity (for example corporate VPN), resync and prove stable time before attended administration. Receipt: docs/evidence/2026-09-14-native-access-clock-check.json. No provider request, approval consumption or persistent clock configuration change occurred.

Evidence and completion review — 2026-09-14

docs/evidence/2026-09-14-ir-wp-0004-review.md maps each remaining acceptance step to evidence and dependency. Added a public OpenRouter catalog adapter and retained live capture/transcription: all three configured IDs listed and base prices within caps, but account access and benchmark comparability stay unknown. The five vendor instruments do not match the original task selection or default API harness. The 20 correlated controlled cases are a pilot, not representative field calibration. T01/T03 remain progress; T02 remains wait on native delivery and billing. No campaign/request changes, paid inference calls, or scope removals.

Closure and residual handoff — 2026-09-14

User requested closure with credential delivery and billing separated. This is closure of the delivered increment and transfer of unfinished scope, not a claim that original research acceptance or native access has been achieved. Original T01–T03 are cancel because their remaining execution moves to the live records below; their implementation/evidence history above is preserved.

Original scope	Authoritative follow-up
T01 comparable profiles and eligibility	IR-WP-0007-T01; credential evidence from IR-WP-0005
T02 credential prerequisite	IR-WP-0005-T01/T02, coordinating SECRETS-WP-0010-T03
T02 billing and pending reservation	IR-WP-0006-T01–T03
T02 representative trials/calibration	IR-WP-0007-T02
T03 publication/operations and decomposition	IR-WP-0007-T03/T04

Delivered: retained source/transcription evidence, public provider catalog adapter, portable bundles, budgeted controlled runner and no-network trial plans, editorial completion assessment, and 40 passing tests plus repository/archive integrity. No completed real trial, verified provider spend or production calibration is claimed. USD 0.023712 remains reserved; USD 10 remains the campaign authorization. Credential work and billing work may progress independently; paid trials require both readiness handoffs. Railiance Clock remains separate owner work.