tegwick
21030784b1
Assistant: codex Assistant-Model: gpt-6-astra Assistant-Session: 01a0cffe-206f-7323-89d3-b20ca4cf4bf9
27 lines
1.7 KiB
Markdown
27 lines
1.7 KiB
Markdown
# Human review handoff
|
|
|
|
Status: a user-submitted model-assisted worksheet has been incorporated separately.
|
|
It declares model authorship, so no independent human scores are recorded. The blank
|
|
materials below remain available for that distinct validation step.
|
|
|
|
Start here without opening assignment.json, raw/, results or editorial scores.
|
|
Read [the scoring rules](../protocol.md) and [the scenarios/rubric](../scenarios.json).
|
|
Each scenario has U and V responses in [masked](../masked/). These are the actual
|
|
model answers without condition metadata; no semantic redaction was applied.
|
|
|
|
Use the [combined worksheet](worksheet.md) for a readable form with all briefs and
|
|
answers, or copy [the empty scoring sheet](scores-template.json) to a new file. Enter your name,
|
|
date and whether you saw the assignment or prior scores. For each answer, score
|
|
C1, C2, R and Q as 1 or 0 using the frozen rubric, with quotations or locators.
|
|
List unsupported guarantees separately (use [] only after checking). No credit for
|
|
pattern vocabulary. Flag ambiguity and suspected condition clues. Return your sheet
|
|
before inspecting the assignment key. No result is implied by this template.
|
|
|
|
This is 12 short answers across six pairs. Reviewing all is preferred; if reviewing
|
|
a subset, record which were chosen before reading them. A partial review remains
|
|
partial. The repository owner prepared the materials and editorial scores; a human
|
|
reviewer provides the independent assessment still missing from this pilot.
|
|
|
|
After submission, compare disagreements against the same rubric and retain both
|
|
original judgments and any adjudication. Do not replace disagreement with an average
|
|
or silently overwrite the original sheet. Work owner: FEP-WP-0002 T03.
|