coulomb/frontend-patterns
5
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Establish phased research program with evidence and validation gates

Browse source 
Assistant: codex
Assistant-Model: gpt-6-astra
Assistant-Session: 01a0cffe-206f-7323-89d3-b20ca4cf4bf9
This commit is contained in:
tegwick 2026-09-24 07:58:09 +02:00
parent 2a5dabdc85
commit 8a141b7fe5
12 changed files with 438 additions and 113 deletions
Download patch file Download diff file Expand all files Collapse all files

48
workplans/FEP-WP-0004-reference-surface.md Normal file
View file

@ -0,0 +1,48 @@
---
id: FEP-WP-0004
type: workplan
title: "Evaluate retrieval and real repository applicability"
domain: infotech
repo: frontend-patterns
status: proposed
owner: codex
topic_slug: canon
created: "2026-09-24"
updated: "2026-09-24"
---
# Evaluate retrieval and real repository applicability
Part of `research/plan/ResearchProgram.md`. Phase prerequisite: FEP-WP-0003's evidence
gate. This is planned follow-up, not an active background execution request.
Individual task descriptions identify any work that can start earlier.
## Validate metadata and export the graph
```task
id: FEP-WP-0004-T01
status: todo
priority: high
```
After the schema and seed examples pass M1, implement the smallest validator/exporter needed to check unique IDs, allowed values, relation targets and evidence references. Add meaningful invalid and valid fixtures; preserve prose and source provenance.
## Evaluate held-out retrieval cases
```task
id: FEP-WP-0004-T02
status: todo
priority: medium
```
After M2, freeze a corpus revision and evaluate at least six unseen prompts following ValidationCases.md. Record expected alternatives, abstentions, unsupported claims and missed constraints; compare with manual navigation. Address Q07.
## Test against real repository revisions
```task
id: FEP-WP-0004-T03
status: todo
priority: medium
```
Study at least two contrasting accessible repositories at recorded revisions. Separate observed implementation from inferred intent. Write research/reviews/M3-EmpiricalReview.md, publish limitations, and hand remaining findings into live work records.