coulomb/frontend-patterns
5
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Report inconclusive presentation pilot and prepare human adjudication

Browse source 
Assistant: codex
Assistant-Model: gpt-6-astra
Assistant-Session: 01a0cffe-206f-7323-89d3-b20ca4cf4bf9
This commit is contained in:
tegwick 2026-09-26 20:07:55 +02:00
parent 3690af12a5
commit 629bc2e880
10 changed files with 932 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

16
workplans/FEP-WP-0002-seed-language-validation.md
View file

@ -288,3 +288,19 @@ condition-masked editorial scores before unmasking. Do not claim human validatio
Human follow-up remains part of T03: prepare masked answers/rubric/empty score sheet
for independent human review, record disagreements and adjudication before claiming
usefulness. No canonical admission or M1 completion follows from the model pilot.
## Presentation pilot results and human handoff — 2026-09-26
T03: all 12 isolated sessions completed through llm-connect, 14,677 reported tokens,
no retries or truncation. Preregistration 6acbe6d; masked editorial scores committed
in 3690af1 before unmasking. Named presentation met 21/24 obligations versus 19/24
for equivalent prose; each had two unsupported claims. Pair comparison: two named
advantages, one prose advantage, three ties. Inconclusive, no human validation.
Human follow-up is explicitly pending within T03: use
research/evaluations/language-pilot-01/human-review/README.md and its empty score
sheet to obtain independent ratings, retain disagreements and adjudicate against
the frozen rubric. No human scores may be inferred or filled by a model. Shared
weaknesses concern policy-dependent retention, atomic supersession and backup/restore.
After human review, revise shared guidance if warranted and replicate on fresh
scenarios. These six briefs are consumed. T02/T03 remain progress; no M1 completion.