markitect-main/markitect
tegwick 7f1eecbdb2 feat(infospace): add eval-summary command and improve evaluate pipeline (S3.3)
- Fix evaluate dimensions to match template file:
  definition_precision, source_grounding, domain_placement,
  vsm_relevance, explanatory_value (was domain_relevance,
  discipline_alignment, conceptual_clarity)
- Add VSM background context to evaluation prompt so LLM can
  score vsm_relevance without macro injection
- Fix model_name bug: was sending literal "default" to API (HTTP 400)
- Refactor run_entity_evaluation to write files incrementally via
  callback rather than all at once after the batch — long runs are
  now resumable if interrupted
- Add incremental skip in CLI: entities with existing eval files
  are skipped automatically on re-run (acts as resume)
- Add eval-summary command: reads all eval files, shows per-dimension
  means, optionally writes per_entity_mean to metrics.yaml
- Fix record_check_results to merge rather than overwrite metrics.yaml
  so per_entity_mean survives subsequent check runs
- Add per_entity_mean viability threshold (min: 3.5) to infospace.yaml

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-02-23 01:26:45 +01:00
..
analysis feat(analysis): add Formal Concept Analysis for coverage gap detection (S1.7) 2026-02-19 01:38:35 +01:00
assets refactor: failed attempt at edit mode recovery and robustness implementation 2025-11-12 00:19:03 +01:00
core feat(infospace): add entity metadata parser (S1.1) 2026-02-19 00:27:45 +01:00
explode_variants feat: complete Issue #150 - Advanced Packaging Features (.mdz, .mdt) 2025-10-13 23:09:18 +02:00
finance feat: reorganize tests by capability with separate test targets 2025-10-25 02:37:45 +02:00
graphql feat(spaces): implement Phase 6 API Layer 2026-02-08 12:29:11 +01:00
helper feat(llm): add llm-default and llm-preference commands, switch hardcoded default to gemini 2026-02-13 16:35:44 +01:00
infospace feat(infospace): add eval-summary command and improve evaluate pipeline (S3.3) 2026-02-23 01:26:45 +01:00
legacy feat: Complete Issue #39 - Database CLI Reorganization with Comprehensive Legacy Compatibility System 2025-09-30 17:28:39 +02:00
llm fix(pipeline): retry on 0-entity response, save raw debug, improve template 2026-02-19 14:26:28 +01:00
matter_contentmatter feat: Complete Issue #38 - Full MarkdownMatters CLI implementation with TDD8 methodology 2025-10-02 09:14:24 +02:00
matter_frontmatter feat: implement comprehensive front matter preservation and unicode handling 2025-10-13 20:26:08 +02:00
matter_tailmatter feat: Complete Issue #38 - Full MarkdownMatters CLI implementation with TDD8 methodology 2025-10-02 09:14:24 +02:00
packaging feat: complete Issue #150 - Advanced Packaging Features (.mdz, .mdt) 2025-10-13 23:09:18 +02:00
plugins feat: consolidate testdrive-jsui to capabilities and implement plugin self-declaration 2025-12-15 23:42:54 +01:00
production feat: complete Issue #145 - Phase 4: Production Readiness and Release 2025-10-14 18:15:26 +02:00
profile feat: implement comprehensive User Profile Management System (issue #107) 2025-10-04 01:53:31 +02:00
prompts feat(prompts): add batch LLM evaluation orchestrator (S1.6) 2026-02-19 01:40:13 +01:00
proxy fix(proxy): catch markitdown missing-dependency errors with clean hint 2026-02-13 21:00:51 +01:00
query_paradigms feat: reorganize tests by capability with separate test targets 2025-10-25 02:37:45 +02:00
schema feat(schema): add semantic schema generation as default mode 2026-02-16 18:49:50 +01:00
schemas feat: add changelog schema for Keep a Changelog validation 2026-01-06 13:31:02 +01:00
spaces feat(spaces): implement Phase 8 Git History Tracking 2026-02-08 18:03:35 +01:00
static/css feat: Complete Phase 4 - Remove legacy JavaScript files 2025-12-16 10:27:05 +01:00
storage feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
template feat: Complete Issue #65 Template Engine Foundation + Fix CLI Regression 2025-10-02 15:33:32 +02:00
templates fix: CSS injection and theme application bugs 2025-12-17 12:02:42 +01:00
themes feat: implement modular theme system with file-based theme organization 2025-11-10 11:43:25 +01:00
validators feat: add LinkValidator for semantic link validation (Phase 3) 2026-01-06 03:41:03 +01:00
__init__.py chore: gitignore and repo cleanup 2025-09-16 03:04:18 +02:00
__version__.py refactor(version): separate version and release commands 2026-02-13 17:49:14 +01:00
asset_commands.py feat: implement Issue #143 - CLI integration and user experience for asset management 2025-10-14 13:46:34 +02:00
associated_files.py feat: Complete Issue #40 - Associated Files Management with Interactive vs Automation Mode System 2025-09-30 13:09:37 +02:00
ast_cache.py feat: Strategic pivot to CLI implementation with comprehensive foundation 2025-09-24 01:14:27 +02:00
ast_service.py fix: Improve AST display content visibility for Issue #15 2025-09-27 09:31:47 +02:00
batch_processor.py feat: implement batch processing and recursive operations (issue #17) 2025-10-03 10:45:43 +02:00
cache_service.py feat: Complete logging standardization with context-aware system 2025-09-27 08:28:10 +02:00
clean_document_manager.py refactor(version): separate version and release commands 2026-02-13 17:49:14 +01:00
cli.py feat(infospace): add lifecycle CLI commands — init, status, entities, viability (S2.2) 2026-02-19 01:46:54 +01:00
cli_utils.py feat: implement Issue #143 - CLI integration and user experience for asset management 2025-10-14 13:46:34 +02:00
config_manager.py feat: optimize code quality with pylint analysis and critical fixes - Issue #130 2025-10-06 03:03:38 +02:00
database.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
document_manager.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
draft_generator.py refactor: enhance draft generator documentation and code quality 2025-10-03 10:35:16 +02:00
exceptions.py feat: optimize code quality with pylint analysis and critical fixes - Issue #130 2025-10-06 03:03:38 +02:00
frontmatter.py feat: optimize code quality with pylint analysis and critical fixes - Issue #130 2025-10-06 03:03:38 +02:00
legacy_compat.py feat: optimize code quality with pylint analysis and critical fixes - Issue #130 2025-10-06 03:03:38 +02:00
legacy_integration_example.py feat: Complete Issue #39 - Database CLI Reorganization with Comprehensive Legacy Compatibility System 2025-09-30 17:28:39 +02:00
metaschema.py feat: implement Phase 1 - Enhanced Schema Format with Classifications 2026-01-04 21:02:51 +01:00
parser.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
performance_tracker.py feat: optimize code quality with pylint analysis and critical fixes - Issue #130 2025-10-06 03:03:38 +02:00
schema_analyzer.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
schema_generator.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
schema_loader.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
schema_naming.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
schema_refiner.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
schema_validator.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
semantic_validator.py feat: complete schema-evolution topic with ADR schema and markdown support 2026-01-06 12:32:38 +01:00
serializer.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00
stub_generator.py feat: optimize code quality with pylint analysis and critical fixes - Issue #130 2025-10-06 03:03:38 +02:00
validation_error.py feat: Complete Issue #8 - Detailed Validation Error Reporting and CLI Enhancements 2025-09-29 21:21:21 +02:00
workspace.py feat(spaces): implement Phase 0-1 of Information Space Service 2026-02-08 02:02:46 +01:00