markitect-main/markitect/infospace
tegwick 7f1eecbdb2 feat(infospace): add eval-summary command and improve evaluate pipeline (S3.3)
- Fix evaluate dimensions to match template file:
  definition_precision, source_grounding, domain_placement,
  vsm_relevance, explanatory_value (was domain_relevance,
  discipline_alignment, conceptual_clarity)
- Add VSM background context to evaluation prompt so LLM can
  score vsm_relevance without macro injection
- Fix model_name bug: was sending literal "default" to API (HTTP 400)
- Refactor run_entity_evaluation to write files incrementally via
  callback rather than all at once after the batch — long runs are
  now resumable if interrupted
- Add incremental skip in CLI: entities with existing eval files
  are skipped automatically on re-run (acts as resume)
- Add eval-summary command: reads all eval files, shows per-dimension
  means, optionally writes per_entity_mean to metrics.yaml
- Fix record_check_results to merge rather than overwrite metrics.yaml
  so per_entity_mean survives subsequent check runs
- Add per_entity_mean viability threshold (min: 3.5) to infospace.yaml

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-02-23 01:26:45 +01:00
..
checks docs(metrics): clarify C2 coverage — domain×chapter matrix, not domain×VSM 2026-02-20 00:08:46 +01:00
__init__.py feat(infospace): add infospace configuration model and state (S2.1) 2026-02-19 01:44:14 +01:00
cli.py feat(infospace): add eval-summary command and improve evaluate pipeline (S3.3) 2026-02-23 01:26:45 +01:00
composition.py feat(infospace): add composition model for discipline binding (S2.6) 2026-02-19 02:03:54 +01:00
config.py feat(pipeline): per-stage max_tokens, LLM provenance, processing log 2026-02-19 14:50:49 +01:00
entity_parser.py feat(example): add supply-chain-vsm composition demo (S3.5) 2026-02-23 00:08:51 +01:00
evaluate.py feat(infospace): add eval-summary command and improve evaluate pipeline (S3.3) 2026-02-23 01:26:45 +01:00
evaluation.py feat(infospace): add structured evaluation output with history and diffing (S1.5) 2026-02-19 01:35:22 +01:00
evaluation_io.py feat(infospace): add structured evaluation output with history and diffing (S1.5) 2026-02-19 01:35:22 +01:00
history.py feat(infospace): add eval-summary command and improve evaluate pipeline (S3.3) 2026-02-23 01:26:45 +01:00
models.py feat(infospace): add entity metadata parser (S1.1) 2026-02-19 00:27:45 +01:00
pipeline.py fix(pipeline): retry on all LLM errors (not just rate limits) 2026-02-19 20:32:23 +01:00
schema.py feat(infospace): add schema compliance validator (S1.2) 2026-02-19 00:48:57 +01:00
state.py feat(infospace): add infospace configuration model and state (S2.1) 2026-02-19 01:44:14 +01:00
validator.py feat(infospace): add schema compliance validator (S1.2) 2026-02-19 00:48:57 +01:00