coulomb/intelligence-radar
5
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Build reproducible capability advisor and scheduled source capture

Browse source 
Assistant: codex
Assistant-Model: gpt-6-astra
Assistant-Session: 01a09c77-b1a9-7eb3-b501-6cb24b458c97
This commit is contained in:
tegwick 2026-09-13 23:07:41 +02:00
parent a1edefd7c5
commit 29ceb77938
68 changed files with 2431 additions and 85 deletions
Download patch file Download diff file Expand all files Collapse all files

45
SCOPE.md
View file

@ -1,23 +1,34 @@
# Scope
## Implemented
## Implemented v0.2
- Governing intent, concept model, architecture, research program, benchmark and source catalogs.
- Compendium, watchlist, historical draft digests and frontier snapshots from both explorations.
- One authoritative task evaluation method, policy baseline, and manual ticket workflow.
- Python CLI: validate and record immutable observation envelopes; validate the ledger;
generate daily or ISO-weekly digest drafts by observation event date.
- Local checks and a synthetic end-to-end demonstration.
- Coulomb workplans, agent entry points, classification and capability registry.
- Compendium, research program and historical explorations with explicit provenance.
- Bounded HTTPS source capture, retained content-addressed artifacts, change receipts,
review-needed observations, deduplication and per-source ingestion health.
- Task-specific five-instrument selection, exact profile/deployment identity,
constraints, benchmark score normalization, fitness ranking and workload cost scenarios.
- Empirical outcome recording with unique runs, exact-task/profile Wilson intervals,
provisional sufficiency thresholds and explicit missing evidence.
- Frozen recommendations, deterministic historical replay and Markdown reports.
- Configured Europe/Berlin daily/weekly job runner, retries, locking, health receipts,
and user systemd timer units for the local workstation.
- Twenty-one behavior tests and isolated ledger/advisor demonstrations.
- Coulomb workplans and Statehub integration.
## Boundaries
## Current evidence boundary
Statehub tracks repository work; `data/observations/` holds research evidence.
A digest records what was observed; editorial review determines whether a claim
is supported. A content hash proves local integrity, not truth or source authenticity.
Imported claims and source catalog status labels remain unverified research leads.
Four primary source pages have been captured. A reviewed two-profile price comparison
is retained, but requester access and exact benchmark results are not evidenced.
The initial real comparison therefore withholds Frontier/Efficient/Budget winners.
Other imported claims remain unverified research leads. Real task outcomes are absent;
full ranking and calibration behavior are demonstrated with isolated synthetic fixtures.
The advisor is manually operated. No calibrated success predictor, provider adapter,
automated benchmark selector, live price feed, API server, PostgreSQL deployment,
scheduled worker, or production UI exists yet. These belong to IR-WP-0003.
No live model recommendation is warranted by the synthetic demo.
The implementation is a local CLI and curator workflow, not a hosted service or UI.
It does not execute model calls, learn cross-task calibration, extract trustworthy
facts automatically, optimize decomposition, or estimate empirical cost/runtime
quantiles. Published costs are explicit workload scenarios. Catalog expansion and
actual outcome collection continue in IR-WP-0004.
Statehub holds work projections, not research evidence. Artifact hashes prove local
integrity, not truth. Scheduler operation depends on this workstation and its user
service manager; publication still requires editorial synthesis/review.