infospace-bench/workplans
tegwick b9173b6569 IB-WP-0016-T02: chapter-aware chunking and stable IDs
Resolve chapter labels from EPUB nav entries (when present) and from the
first in-document h1/h2/h3 heading, parse roman-numeral and "Chapter N"
labels into numeric chapter indices, and generate stable IDs of the form
chapter-NN with -part-NNN suffix when a chapter exceeds max_words. The
chunker now operates on cleaned body text, distributes id="Page_*" page
anchors per part via inline markers extracted before splitting, and
supports a configurable overlap_words evidence window between adjacent
parts of the same chapter. Reclassify body sections whose chapter label
matches contents/transcriber-notes/license/colophon tokens so they leave
the body stream by default. Strip <head>...</head> from HTML body
extraction to stop the <title> tag from duplicating heading text in the
chunk markdown.

Real Lefevre EPUB now detects all 24 roman-numeral chapters with stable
chapter-NN IDs, distributes Page_N anchors across multi-part chapters,
and reclassifies Contents and Transcriber's Notes out of body
(role histogram body=67, cover=1, header=1, toc=1, notes=1, footer=2).
82 tests pass.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-17 15:52:47 +02:00
..
IB-WP-0001-state-hub-and-repo-bootstrap.md workplan cleanup 2026-05-14 12:46:32 +02:00
IB-WP-0002-infospace-lifecycle-baseline.md Initial implementation 2026-05-14 11:32:25 +02:00
IB-WP-0003-evaluation-and-inspection.md Initial implementation 2026-05-14 11:32:25 +02:00
IB-WP-0004-reference-infospace-pilot.md Initial implementation 2026-05-14 11:32:25 +02:00
IB-WP-0005-orthogonal-successor-architecture.md docs and stuff 2026-05-14 13:47:36 +02:00
IB-WP-0006-markitect-tool-adapter.md markitect-tool integration 2026-05-14 14:53:16 +02:00
IB-WP-0007-entity-relation-model-migration.md entity relationship model 2026-05-14 15:06:17 +02:00
IB-WP-0008-evaluation-history-metrics-parity.md eval history and metrics 2026-05-14 15:35:04 +02:00
IB-WP-0009-applied-workflow-generation-pipeline.md acceptance matrix and workflow generation 2026-05-14 16:01:32 +02:00
IB-WP-0010-kontextual-engine-integration-boundary.md engine and lifecycle 2026-05-14 16:26:42 +02:00
IB-WP-0011-pruned-legacy-reference-pilot.md Kontextual Engine Integration Boundary 2026-05-14 16:43:29 +02:00
IB-WP-0012-replacement-readiness-cli-parity.md command parity and migration guide 2026-05-14 17:16:39 +02:00
IB-WP-0013-wealth-vsm-generation-pipeline-parity.md infospace pipeline for wealth of nations example 2026-05-14 18:04:38 +02:00
IB-WP-0014-infospace-backend-abstraction.md chore(consistency): sync task status from DB [auto] 2026-05-17 11:52:20 +02:00
IB-WP-0015-generic-source-infospace-generator-cli.md generic source-to-infospace generator 2026-05-14 19:33:22 +02:00
IB-WP-0016-lefevre-ebook-infospace-readiness.md IB-WP-0016-T02: chapter-aware chunking and stable IDs 2026-05-17 15:52:47 +02:00
IB-WP-0017-agentic-memory-profile-pilot.md Agentic memory profile 2026-05-15 16:01:35 +02:00