tegwick
8a141b7fe5
Assistant: codex Assistant-Model: gpt-6-astra Assistant-Session: 01a0cffe-206f-7323-89d3-b20ca4cf4bf9
1.5 KiB
| id | type | title | domain | repo | status | owner | topic_slug | created | updated |
|---|---|---|---|---|---|---|---|---|---|
| FEP-WP-0004 | workplan | Evaluate retrieval and real repository applicability | infotech | frontend-patterns | proposed | codex | canon | 2026-09-24 | 2026-09-24 |
Evaluate retrieval and real repository applicability
Part of research/plan/ResearchProgram.md. Phase prerequisite: FEP-WP-0003's evidence
gate. This is planned follow-up, not an active background execution request.
Individual task descriptions identify any work that can start earlier.
Validate metadata and export the graph
id: FEP-WP-0004-T01
status: todo
priority: high
After the schema and seed examples pass M1, implement the smallest validator/exporter needed to check unique IDs, allowed values, relation targets and evidence references. Add meaningful invalid and valid fixtures; preserve prose and source provenance.
Evaluate held-out retrieval cases
id: FEP-WP-0004-T02
status: todo
priority: medium
After M2, freeze a corpus revision and evaluate at least six unseen prompts following ValidationCases.md. Record expected alternatives, abstentions, unsupported claims and missed constraints; compare with manual navigation. Address Q07.
Test against real repository revisions
id: FEP-WP-0004-T03
status: todo
priority: medium
Study at least two contrasting accessible repositories at recorded revisions. Separate observed implementation from inferred intent. Write research/reviews/M3-EmpiricalReview.md, publish limitations, and hand remaining findings into live work records.