Correct the false Qwen3.8-27B claim in the 2026-09-23 brief.
The brief's lead delta asserted a candidate -> approved move that no file
records; the catalog is unchanged since a78187c. Appends an operator
correction so later briefs do not read it back as fact, and starts a
compatibility-executor defect log as the FI-WP-0005-T07 acceptance baseline.
Records activity-core's scope reply (029814b0) on T04.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Assistant: claude-code
Assistant-Model: opus
Assistant-Process: 51320@bnt-lap001
Assistant-Session: 9d40b4c7-8e3c-42ee-b755-d658d4640d6c
This commit is contained in:
parent
67064ec950
commit
ee32b47123
3 changed files with 53 additions and 0 deletions
27
docs/evidence/2026-09-23-brief-defects.md
Normal file
27
docs/evidence/2026-09-23-brief-defects.md
Normal file
|
|
@ -0,0 +1,27 @@
|
|||
# Compatibility executor defect log
|
||||
|
||||
Baseline for the FI-WP-0005-T07 canary comparison: defects produced by the
|
||||
current `rein-aharness fi-research-brief` path (single llm-connect call, no
|
||||
network access, no primary sources). The canary must not reproduce these.
|
||||
|
||||
| Date | Defect | Class | Evidence |
|
||||
| --- | --- | --- | --- |
|
||||
| 2026-08-04…14 | DeepSeek-V4-Flash-0731 reported as a 12B dense model; once claimed as already collected | invented facts; false collection claim | Corrected in `inventory/catalog/deepseek-ai__DeepSeek-V4-Flash-0731__strategic.yaml` history (FI-WP-0004-T05) |
|
||||
| 2026-09-23 | "Qwen3.8-27B has been moved from 'candidate' to 'approved'" | invented state change; contradicts the catalog | Catalog unchanged since `a78187c`; `approved_by` empty. Correction appended to `briefs/2026/09/2026-09-23.md` |
|
||||
|
||||
## Pattern
|
||||
|
||||
Both defects are assertions about **lab state** that the brief had in its own
|
||||
context and still got wrong, not stale knowledge about the outside world. The
|
||||
executor receives the catalog and the previous brief, then narrates a change
|
||||
that no file records.
|
||||
|
||||
Consequences for the FI-WP-0005 acceptance run (T07):
|
||||
|
||||
1. Compare canary output against the catalog for every claim about collection
|
||||
status, sizes and licenses. Any assertion of a state change must cite the
|
||||
file and revision that made it.
|
||||
2. Briefs with no external delta should say so, rather than manufacturing an
|
||||
internal one. Both defect days had genuinely quiet outside channels.
|
||||
3. A false claim propagates: the previous brief is context for the next one.
|
||||
Corrections belong in the brief file, not only in the workplan.
|
||||
Loading…
Add table
Add a link
Reference in a new issue