infospace-bench/docs
tegwick b9173b6569 IB-WP-0016-T02: chapter-aware chunking and stable IDs
Resolve chapter labels from EPUB nav entries (when present) and from the
first in-document h1/h2/h3 heading, parse roman-numeral and "Chapter N"
labels into numeric chapter indices, and generate stable IDs of the form
chapter-NN with -part-NNN suffix when a chapter exceeds max_words. The
chunker now operates on cleaned body text, distributes id="Page_*" page
anchors per part via inline markers extracted before splitting, and
supports a configurable overlap_words evidence window between adjacent
parts of the same chapter. Reclassify body sections whose chapter label
matches contents/transcriber-notes/license/colophon tokens so they leave
the body stream by default. Strip <head>...</head> from HTML body
extraction to stop the <title> tag from duplicating heading text in the
chunk markdown.

Real Lefevre EPUB now detects all 24 roman-numeral chapters with stable
chapter-NN IDs, distributes Page_N anchors across multi-part chapters,
and reclassifies Contents and Transcriber's Notes out of body
(role histogram body=67, cover=1, header=1, toc=1, notes=1, footer=2).
82 tests pass.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-17 15:52:47 +02:00
..
agentic-memory-profile-pilot.md Agentic memory profile 2026-05-15 16:01:35 +02:00
archive-integration.md IB-WP-0014: archive-list, restore, retention annotation, docs (T03-T05) 2026-05-17 11:46:23 +02:00
entity-relation-model.md entity relationship model 2026-05-14 15:06:17 +02:00
evaluation-and-inspection.md Initial implementation 2026-05-14 11:32:25 +02:00
evaluation-history-and-metrics.md eval history and metrics 2026-05-14 15:35:04 +02:00
generic-source-generator.md generic source-to-infospace generator 2026-05-14 19:33:22 +02:00
infospace-layout.md engine and lifecycle 2026-05-14 16:26:42 +02:00
kontextual-engine-boundary.md engine and lifecycle 2026-05-14 16:26:42 +02:00
lefevre-epub3-validation.md IB-WP-0016-T02: chapter-aware chunking and stable IDs 2026-05-17 15:52:47 +02:00
legacy-command-parity.md infospace pipeline for wealth of nations example 2026-05-14 18:04:38 +02:00
legacy-infospace-feature-inventory.md docs and stuff 2026-05-14 13:47:36 +02:00
legacy-infospace-migration-guide.md command parity and migration guide 2026-05-14 17:16:39 +02:00
markitect-main-scope-assessment.md State-hub connect and initial workplans 2026-05-03 20:43:56 +02:00
markitect-tool-adapter.md markitect-tool integration 2026-05-14 14:53:16 +02:00
markitect-tool-and-infospace-replacement-assessment.md Reestablishing intent based goals and workplans 2026-05-14 13:09:58 +02:00
orthogonal-successor-roadmap.md docs and stuff 2026-05-14 13:47:36 +02:00
reference-pilot-decision.md Initial implementation 2026-05-14 11:32:25 +02:00
replacement-acceptance-matrix.md infospace pipeline for wealth of nations example 2026-05-14 18:04:38 +02:00
replacement-readiness-decision.md command parity and migration guide 2026-05-14 17:16:39 +02:00
successor-boundary-interface-map.md engine and lifecycle 2026-05-14 16:26:42 +02:00
wealth-vsm-generation-pipeline.md infospace pipeline for wealth of nations example 2026-05-14 18:04:38 +02:00
workflow-generation-pipeline.md acceptance matrix and workflow generation 2026-05-14 16:01:32 +02:00