markitect-main/tests/unit/prompts
tegwick 144a88c0c2 feat(prompts): add batch LLM evaluation orchestrator (S1.6)
BatchEvaluator runs evaluation prompts across item batches with
incremental evaluation (skip unchanged via content digest), per-item
error isolation, progress callbacks, and aggregate token usage tracking.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-19 01:40:13 +01:00
..
__init__.py feat(prompts): implement Phase 1 - Foundation (FR-1) 2026-02-08 22:30:26 +01:00
test_artifact_models.py feat(prompts): implement Phase 1 - Foundation (FR-1) 2026-02-08 22:30:26 +01:00
test_artifact_repository.py fix(prompts): fix three infrastructure bugs in prompt dependency resolution 2026-02-11 20:53:02 +01:00
test_batch_evaluator.py feat(prompts): add batch LLM evaluation orchestrator (S1.6) 2026-02-19 01:40:13 +01:00
test_change_detector.py feat(prompts): implement Phase 6 - Incremental Execution (FR-7, FR-8) 2026-02-09 13:18:27 +01:00
test_context_compiler.py fix(prompts): fix three infrastructure bugs in prompt dependency resolution 2026-02-11 20:53:02 +01:00
test_dependency_models.py feat(prompts): implement Phase 5 - Dependency Tracking (FR-6) 2026-02-09 13:18:18 +01:00
test_dependency_queries.py feat(prompts): implement Phase 5 - Dependency Tracking (FR-6) 2026-02-09 13:18:18 +01:00
test_dependency_repository.py feat(prompts): implement Phase 5 - Dependency Tracking (FR-6) 2026-02-09 13:18:18 +01:00
test_execution_engine.py feat(prompts): implement Phase 4 - Execution Engine (FR-4, FR-5) 2026-02-08 23:15:33 +01:00
test_execution_models.py feat(prompts): implement Phase 4 - Execution Engine (FR-4, FR-5) 2026-02-08 23:15:33 +01:00
test_graph_builder.py feat(prompts): implement Phase 5 - Dependency Tracking (FR-6) 2026-02-09 13:18:18 +01:00
test_halting_policy.py feat(prompts): implement Phase 7 - Quality & Validation (FR-9, FR-10) 2026-02-09 13:31:37 +01:00
test_impact_analyzer.py feat(prompts): implement Phase 6 - Incremental Execution (FR-7, FR-8) 2026-02-09 13:18:27 +01:00
test_incremental_engine.py feat(prompts): implement Phase 6 - Incremental Execution (FR-7, FR-8) 2026-02-09 13:18:27 +01:00
test_macro_parser.py fix(prompts): fix three infrastructure bugs in prompt dependency resolution 2026-02-11 20:53:02 +01:00
test_prompt_resolver.py feat(prompts): implement Phase 3 - Resolver Engine (FR-3) 2026-02-08 22:45:46 +01:00
test_quality_gates.py feat(prompts): implement Phase 7 - Quality & Validation (FR-9, FR-10) 2026-02-09 13:31:37 +01:00
test_quality_validator.py feat(prompts): implement Phase 7 - Quality & Validation (FR-9, FR-10) 2026-02-09 13:31:37 +01:00
test_query_operations.py feat(prompts): implement Phase 8 - Observability & Traceability (FR-11) 2026-02-09 20:32:18 +01:00
test_refinement_loop.py feat(prompts): implement Phase 7 - Quality & Validation (FR-9, FR-10) 2026-02-09 13:31:37 +01:00
test_resolution_strategy.py feat(prompts): implement Phase 3 - Resolver Engine (FR-3) 2026-02-08 22:45:46 +01:00
test_template_models.py fix(prompts): fix three infrastructure bugs in prompt dependency resolution 2026-02-11 20:53:02 +01:00
test_traceability_service.py feat(prompts): implement Phase 8 - Observability & Traceability (FR-11) 2026-02-09 20:32:18 +01:00
test_visualization.py feat(prompts): implement Phase 8 - Observability & Traceability (FR-11) 2026-02-09 20:32:18 +01:00