tegwick
29ceb77938
Assistant: codex Assistant-Model: gpt-6-astra Assistant-Session: 01a09c77-b1a9-7eb3-b501-6cb24b458c97
1.8 KiB
| id | type | title | domain | repo | status | owner | topic_slug | created | updated |
|---|---|---|---|---|---|---|---|---|---|
| IR-WP-0004 | workplan | Expand verified evidence and calibrate against field outcomes | infotech | intelligence-radar | backlog | codex | custodian | 2026-09-13 | 2026-09-13 |
Expand verified evidence and calibrate against field outcomes
Residual research and product scope from IR-WP-0003. v0.2 implements the mechanics; this work grows the evidence and operational reach without inventing calibration.
Build complete comparable profile evidence
id: IR-WP-0004-T01
status: todo
priority: high
Review exact versions, harnesses, effort and scores for five task-relevant instruments. Expand beyond the two-profile dated price comparison. Preserve conflicting results and independently verify requester access. Acceptance: at least two eligible profiles with complete comparable evidence and a source-backed Frontier/Efficient comparison. All other imported model/benchmark claims remain research leads until reviewed.
Collect representative real task outcomes
id: IR-WP-0004-T02
status: todo
priority: high
Run an explicitly budgeted sample of representative tasks with retained verifier artifacts. Record successes and failures, actual cost and runtime. Evaluate selection bias and dependence before treating Wilson bounds as predictive. Develop versioned cross-task calibration and measured cost/runtime intervals only when justified.
Extend publication and hosted operation
id: IR-WP-0004-T03
status: todo
priority: medium
Add curated source adapters and editorial synthesis, artifact retention/export, reviewed source coverage, and a deployment-independent worker if continuous uptime is required. Add decomposition comparisons against measured monolithic outcomes. Keep draft creation separate from reviewed publication and any notifications.