coulomb/evidence-source
4
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
evidence-source/workplans/ESRC-WP-0002-html-markdown-representations.md
tegwick 97437dfa18
Some checks failed
CI Smoke / host-smoke (push) Successful in 0s
Details
CI Smoke / container-smoke (push) Failing after 15m18s
Details
Implement ESRC-WP-0002/0003/0004: HTML/MD ingest, metadata, recovery 
Add ingestHtml and ingestMarkdown with ADR-0003 pageless offset semantics,
PDF intrinsic metadata extraction with caller-wins merge (WP-0003), and
citation recovery primitives including re-ingest reconcile, local quote
search, and pluggable discovery hooks (ADR-0004). Mark all three workplans
finished with contract tests (80 passing).
2026-07-09 01:48:28 +02:00

1.8 KiB
Raw Blame History

id type title domain repo status owner topic_slug created updated spec_refs state_hub_workstream_id
ESRC-WP-0002 workplan HTML and Markdown source representations infotech evidence-source finished codex citation_evidence_mvp 2026-07-08 2026-07-09
README.md
docs/ADR-0001-extraction-boundary.md
docs/ADR-0003-html-markdown-representation.md
../citation-engine/src/shared/document.ts
c0d28886-e02f-4df2-abb6-ebe179171c94

ESRC-WP-0002 — HTML and Markdown source representations

The PDF slice (ESRC-WP-0001) established the ingest boundary and contract shape. This workplan extends ingest to HTML and Markdown sources, producing the same { document, representation } pair over engine-owned contracts.

Decisions (ADR-0003)

  • HTML maps to representationType: "html-dom"; Markdown to "markdown-rendered".
  • Pageless formats omit pageMap; offsetMap is a single synthetic page-1 range covering [0, canonicalText.length).
  • Inline fixtures owned by this repo (no PII); PDF corpus rules unchanged.

Sketch

id: ESRC-WP-0002-T01
status: done
priority: medium
state_hub_task_id: "bf1d2a2f-41b4-44b5-b1d1-4f0eec5fbf59"

Define the HTML/MD representation contract with citation-engine; agree representationType and any offset/page semantics for pageless formats.

id: ESRC-WP-0002-T02
status: done
priority: medium
state_hub_task_id: "66320911-a4b2-404f-b025-8b23dc0c9680"

Implement ingestHtml / ingestMarkdown in src/html/ and src/markdown/, reusing fingerprintBytes and the canonical-text normalizer.

id: ESRC-WP-0002-T03
status: done
priority: medium
state_hub_task_id: "266d168c-d93e-4387-9527-70aa0d5b2a6b"

Add fixture-driven contract tests mirroring the PDF suite; decide fixture ownership per ADR-0002.