coulomb/markitect-main
4
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
markitect-main/markitect
History
tegwick 0982e771e4 feat: implement batch processing and recursive operations (issue #17) 
Complete implementation of batch processing capabilities for MarkiTect CLI:

New CLI Commands:
- markitect ingest-dir: Process all markdown files in directory with recursive support
- markitect batch-process: Process files matching glob patterns
- markitect recursive: Recursive processing with depth control

Core Features:
- Sophisticated batch processing engine with progress tracking
- Multiple error handling strategies (stop, continue, skip)
- Recursive directory traversal with configurable depth limits
- Glob pattern matching for flexible file selection
- Progress feedback with detailed processing statistics
- Integration with existing database and caching systems

Technical Implementation:
- BatchProcessor class with modular architecture
- ProgressTracker for real-time user feedback
- Comprehensive error handling and edge case management
- Support for multiple operations (ingest, status, validate)
- Depth-controlled recursive search with proper boundary handling
- Permission error resilience and graceful degradation

Testing:
- 29 comprehensive tests covering all functionality
- Edge cases: empty directories, hidden files, permission errors
- CLI integration tests with mocked database operations
- Depth logic validation and boundary condition testing
- Error handling scenarios and recovery mechanisms

All acceptance criteria fulfilled:
✅ Directory and recursive processing
✅ Glob pattern support for file selection
✅ Progress tracking and user feedback
✅ Error handling with continuation options
✅ Comprehensive test coverage

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-03 10:45:43 +02:00
..
content feat: Complete Issue #38 TDD8 Cycle 1 - Content command family implementation 2025-10-02 08:14:38 +02:00
issues feat: Complete Issue #65 Template Engine Foundation + Fix CLI Regression 2025-10-02 15:33:32 +02:00
legacy feat: Complete Issue #39 - Database CLI Reorganization with Comprehensive Legacy Compatibility System 2025-09-30 17:28:39 +02:00
matter_contentmatter feat: Complete Issue #38 - Full MarkdownMatters CLI implementation with TDD8 methodology 2025-10-02 09:14:24 +02:00
matter_frontmatter feat: Complete Issue #41 - Add TOML frontmatter support 2025-10-02 09:32:16 +02:00
matter_tailmatter feat: Complete Issue #38 - Full MarkdownMatters CLI implementation with TDD8 methodology 2025-10-02 09:14:24 +02:00
schemas feat: Complete Issue #50 - Define metaschema for JSON schema structure 2025-10-01 02:39:29 +02:00
template feat: Complete Issue #65 Template Engine Foundation + Fix CLI Regression 2025-10-02 15:33:32 +02:00
__init__.py chore: gitignore and repo cleanup 2025-09-16 03:04:18 +02:00
__version__.py feat: implement markitect installer with version/release commands (issue #80) 2025-10-03 05:47:02 +02:00
associated_files.py feat: Complete Issue #40 - Associated Files Management with Interactive vs Automation Mode System 2025-09-30 13:09:37 +02:00
ast_cache.py feat: Strategic pivot to CLI implementation with comprehensive foundation 2025-09-24 01:14:27 +02:00
ast_service.py fix: Improve AST display content visibility for Issue #15 2025-09-27 09:31:47 +02:00
batch_processor.py feat: implement batch processing and recursive operations (issue #17) 2025-10-03 10:45:43 +02:00
cache_service.py feat: Complete logging standardization with context-aware system 2025-09-27 08:28:10 +02:00
cli.py feat: implement batch processing and recursive operations (issue #17) 2025-10-03 10:45:43 +02:00
database.py feat: Complete Issue #3 - Schema Management with Enhanced Format Control 2025-09-30 02:59:43 +02:00
document_manager.py feat: Strategic pivot to CLI implementation with comprehensive foundation 2025-09-24 01:14:27 +02:00
draft_generator.py refactor: enhance draft generator documentation and code quality 2025-10-03 10:35:16 +02:00
exceptions.py feat: Implement Issue #54 - Add content field instruction capabilities 2025-10-01 08:21:42 +02:00
frontmatter.py feat: Implement Issue #1 - Database initialization and front matter parsing 2025-09-23 04:28:29 +02:00
legacy_compat.py feat: Complete Issue #39 - Database CLI Reorganization with Comprehensive Legacy Compatibility System 2025-09-30 17:28:39 +02:00
legacy_integration_example.py feat: Complete Issue #39 - Database CLI Reorganization with Comprehensive Legacy Compatibility System 2025-09-30 17:28:39 +02:00
metaschema.py feat: Complete Issue #50 - Define metaschema for JSON schema structure 2025-10-01 02:39:29 +02:00
parser.py feat: Complete Issue #8 - Detailed Validation Error Reporting and CLI Enhancements 2025-09-29 21:21:21 +02:00
performance_tracker.py feat: Add comprehensive performance tracking system 2025-10-02 17:37:24 +02:00
schema_generator.py feat: Implement Issue #54 - Add content field instruction capabilities 2025-10-01 08:21:42 +02:00
schema_validator.py feat: Complete Issue #52 - Capture actual heading text in schemas 2025-10-01 08:03:11 +02:00
serializer.py feat: Complete Issue #2 - Fast Document Loading & CLI Manipulation ⭐ MAJOR MILESTONE 2025-09-25 03:01:40 +02:00
stub_generator.py feat: Fix Issue #46 - Schema generation outline mode draft integration 2025-10-01 16:16:46 +02:00
validation_error.py feat: Complete Issue #8 - Detailed Validation Error Reporting and CLI Enhancements 2025-09-29 21:21:21 +02:00