frontend-patterns/research/evaluations/language-pilot-01/human-review/README.md
tegwick 21030784b1 Incorporate submitted pilot review and adjudicate four score differences
Assistant: codex
Assistant-Model: gpt-6-astra
Assistant-Session: 01a0cffe-206f-7323-89d3-b20ca4cf4bf9
2026-09-26 21:06:38 +02:00

1.7 KiB

Human review handoff

Status: a user-submitted model-assisted worksheet has been incorporated separately. It declares model authorship, so no independent human scores are recorded. The blank materials below remain available for that distinct validation step.

Start here without opening assignment.json, raw/, results or editorial scores. Read the scoring rules and the scenarios/rubric. Each scenario has U and V responses in masked. These are the actual model answers without condition metadata; no semantic redaction was applied.

Use the combined worksheet for a readable form with all briefs and answers, or copy the empty scoring sheet to a new file. Enter your name, date and whether you saw the assignment or prior scores. For each answer, score C1, C2, R and Q as 1 or 0 using the frozen rubric, with quotations or locators. List unsupported guarantees separately (use [] only after checking). No credit for pattern vocabulary. Flag ambiguity and suspected condition clues. Return your sheet before inspecting the assignment key. No result is implied by this template.

This is 12 short answers across six pairs. Reviewing all is preferred; if reviewing a subset, record which were chosen before reading them. A partial review remains partial. The repository owner prepared the materials and editorial scores; a human reviewer provides the independent assessment still missing from this pilot.

After submission, compare disagreements against the same rubric and retain both original judgments and any adjudication. Do not replace disagreement with an average or silently overwrite the original sheet. Work owner: FEP-WP-0002 T03.