coulomb/infospace-bench
5
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
infospace-bench/workplans/IB-WP-0008-evaluation-history-metrics-parity.md
tegwick ffd2255a55
All checks were successful
CI Smoke / host-smoke (push) Successful in 0s
Details
CI Smoke / container-smoke (push) Successful in 1s
Details
docs(workplans): mark closed infospace workplans finished 
IB-WP-0001 through IB-WP-0019 had every task done or cancelled, but
their frontmatter still used done or completed. Those are not workplan
statuses. Record them as finished.

Assistant: grok
Assistant-Session: 01a137af-2bea-7940-9a65-acd892344a72
2026-10-14 06:46:27 +02:00

2 KiB
Raw Blame History

id type title domain repo status owner topic_slug created updated state_hub_workstream_slug state_hub_workstream_id
IB-WP-0008 workplan Evaluation History And Metrics Parity communication infospace-bench finished markitect markitect 2026-05-14 2026-10-14 ib-wp-0008-evaluation-history-metrics-parity f00ba036-dc97-4370-a4a5-9ac2bce7ce6f

IB-WP-0008 — Evaluation History And Metrics Parity

Goal

Bring the current evaluation dataclasses up to practical parity with the old infospace evaluation history and metrics behavior.

Tasks

T01 — Evaluation file I/O

id: IB-WP-0008-T01
status: done
priority: high
state_hub_task_id: "95b48ad3-c4d1-442c-9bc0-7591d948d23e"
  • Write and read per-entity/per-artifact evaluation files
  • Preserve human-readable Markdown body plus structured metadata
  • Add round-trip tests

T02 — Snapshot history

id: IB-WP-0008-T02
status: done
priority: high
state_hub_task_id: "b4800ba8-5b86-44bb-bf47-e893bae36b22"
  • Write, append, and read evaluation snapshot history
  • Support diffing named snapshots from disk
  • Add CLI support for history and history-diff behavior

T03 — Metrics merge and viability reports

id: IB-WP-0008-T03
status: done
priority: high
state_hub_task_id: "7abcbd63-0147-4ae8-85f0-4af51882f476"
  • Persist latest metrics under output/metrics
  • Merge collection metrics with evaluation-derived metrics
  • Emit structured viability reports

T04 — Legacy metric compatibility notes

id: IB-WP-0008-T04
status: done
priority: medium
state_hub_task_id: "675d1d45-39d9-4ddd-9ab7-5d7de8a0f601"
  • Compare old metric names and meanings to new baseline
  • Document changed semantics and accepted differences
  • Add fixtures that preserve critical old behavior

Acceptance

  • Evaluation and metrics history are inspectable, diffable, and reproducible
  • Viability reports can be generated from committed files
  • Old evaluation-history workflows have a clear replacement path