coulomb/frontend-patterns
5
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Retain failed authorized replication and reconcile gap work

Browse source 
Assistant: codex
Assistant-Model: gpt-6.1-sol
Assistant-Session: 01a1045b-933d-7aa1-b2db-104557487a79
This commit is contained in:
tegwick 2026-10-04 11:15:05 +02:00
parent 88826ca598
commit 5da8b2405c
40 changed files with 2816 additions and 10 deletions
Download patch file Download diff file Expand all files Collapse all files

8
SCOPE.md
View file

@ -26,7 +26,7 @@ Research fixtures exercise bounded mechanisms; they are not implementation recip
| Implementation mappings | Locate scoped mechanisms for transactional and offline recovery | [TransactionalRecovery](technologies/TransactionalRecovery.md), [OfflineRecovery](technologies/OfflineRecovery.md); no product supplies a certified complete configuration |
| Metadata and publication checks | Validate contract examples, candidate inventory/hashes, classification, evidence locators and immutable release artifacts | `make schema-test evolution-check classification-check reference-check`; checks establish structural traceability, not source truth |
| Research bench | Plan and execute bounded source investigations, retain failures, screen structure and explicitly replay compatible cached runs | [Bench adapter](research/bench/README.md); paid inference uses llm-connect and its task authorization/budget, not automatic invocation |
| Learning visibility | Read a selected retrospective ledger, prospective protocols, measured/unknown effort, immutable snapshots and comparison readiness | [ComparisonWindows.json](research/evolution/ComparisonWindows.json); 8 prospective cycles in 7 declared groups, none reaches the 3-cycle review trigger |
| Learning visibility | Read a selected retrospective ledger, prospective protocols, measured/unknown effort, immutable snapshots and comparison readiness | [ComparisonWindows.json](research/evolution/ComparisonWindows.json); 9 prospective attempts/cycles in 8 declared groups (one wholly failed execution), none reaches the 3-cycle review trigger |
| Deterministic scheduled reporting | Observe retained natural daily, weekly and October 1 monthly reports from activity-core | [Receipt reconciliation](docs/evidence/2026-10-04-loop-reconciliation.json); zero enrolled consumers, dated owner health snapshot, no admitted pattern-editing executor |
The frozen preview and live research are separate version surfaces. Published candidate
@ -44,7 +44,9 @@ paths. Vocabulary and catalog names do not constitute additional implemented pat
The consumed development pilot scored 18/24 in each presentation condition after
model-review adjudication. It establishes neither a naming benefit nor equivalence.
Independent human scores, fresh-scenario replication and decision-time evidence remain
missing. M1/M2 remain revise/defer, and canonical admission is open. Full canonical graph
missing. Fresh atomic replication tooling and a preregistered 12-attempt run exist,
but all attempts failed without answers; [retained record](research/evaluations/language-replication-02/README.md).
M1/M2 remain revise/defer, and canonical admission is open. Full canonical graph
export, held-out retrieval evaluation and real-repository applicability studies retain
their recorded prerequisites. Eight disclosed preview navigation cases are development
checks; they are not held-out retrieval results.
@ -52,7 +54,7 @@ checks; they are not held-out retrieval results.
Full-contract recurrence, production fitness, accessibility conformance, native crash
and off-device recovery guarantees are not established by the scoped source studies or
authored runtime fixtures. Seven prospective cycles have positive recorded research
time; LEARN-0017's time is unknown. A matching group label is not proof of comparability,
time; LEARN-0017 and LEARN-0019 have unknown research time. A matching group label is not proof of comparability,
and there is no basis for a diminishing-returns or plateau claim.
The capability entry and hosted-publication preparation exist, but hosted federation

4
WORK-RECORDS.md
View file

@ -16,7 +16,7 @@
| workplan | FEP-WP-0006 | blocked | — | workplans/FEP-WP-0006-language-evolution.md |
| workplan | FEP-WP-0007 | finished | — | workplans/FEP-WP-0007-language-v01-preview.md |
| workplan | FEP-WP-0008 | blocked | — | workplans/FEP-WP-0008-use-driven-improvement.md |
| workplan | FEP-WP-0009 | backlog | — | workplans/FEP-WP-0009-m1-independent-validation.md |
| workplan | FEP-WP-0009 | blocked | — | workplans/FEP-WP-0009-m1-independent-validation.md |
| workplan | FEP-WP-0010 | finished | — | workplans/FEP-WP-0010-reference-consumption.md |
| task | FEP-WP-0001-T01 | done | — | workplans/FEP-WP-0001-statehub-bootstrap.md |
| task | FEP-WP-0001-T02 | done | — | workplans/FEP-WP-0001-statehub-bootstrap.md |
@ -45,7 +45,7 @@
| task | FEP-WP-0008-T02 | wait | — | workplans/FEP-WP-0008-use-driven-improvement.md |
| task | FEP-WP-0008-T03 | wait | — | workplans/FEP-WP-0008-use-driven-improvement.md |
| task | FEP-WP-0009-T01 | wait | — | workplans/FEP-WP-0009-m1-independent-validation.md |
| task | FEP-WP-0009-T02 | todo | — | workplans/FEP-WP-0009-m1-independent-validation.md |
| task | FEP-WP-0009-T02 | wait | — | workplans/FEP-WP-0009-m1-independent-validation.md |
| task | FEP-WP-0009-T03 | wait | — | workplans/FEP-WP-0009-m1-independent-validation.md |
| task | FEP-WP-0010-T01 | done | — | workplans/FEP-WP-0010-reference-consumption.md |
| task | FEP-WP-0010-T02 | done | — | workplans/FEP-WP-0010-reference-consumption.md |

32
history/2026-10-04T111438+0200-gap-implementation-and-replication.md Normal file
View file

@ -0,0 +1,32 @@
# Gap implementation and authorized replication — 2026-10-04
All assessed gaps already have live workplan owners: real consumer outcomes WP-0008;
independent validation/fresh replication WP-0009; broader applicability WP-0003/0004;
comparable learning WP-0006. No duplicate workplan was registered.
Implemented and preregistered the [atomic replication packet and runner](../research/evaluations/language-replication-02/README.md),
with isolation, guidance equivalence, immutable input checks, attempt reservation,
no retries and evidence-bearing scoring. Six fresh authored scenarios have six
binary criteria per condition. The user authorized twelve capped calls; all twelve
attempts failed without answers. Host/sandbox health checks found llm-connect unreachable.
All receipts are retained; scores stay null and six pairs are excluded. T02 waits
for restored service and a newly authorized registered run. No provider billing
claim, naming conclusion, human review or maturity advancement is inferred.
A [bounded consumer discovery](../docs/evidence/2026-10-04-consumer-discovery.json)
found no indexed eligible external task in the searched active/ready subset. This
is not a global absence proof. WP-0008 retains discovery, enrollment and actual
linked decisions/outcomes. The local consumption bridge remains available.
Most relevant next gaps remain real consumer decisions/outcomes and independent
human validation. Fresh replication additionally requires working llm-connect;
stronger architecture/application claims and comparable returns remain downstream.
LEARN-0019 retains the failed cycle and unknown research effort. Existing native
workplans retain every residual; frozen pilot/reference evidence is unchanged.
Verification: all 120 repository tests passed before the authorized run. Final
ledger/report checks and 22 evolution plus 16 replication tests passed. The commit
guard regression test was corrected to accept either an absent Git path (before
publication) or a byte mismatch (after publication); both prevent adapter construction.
The frozen runner/input bytes remain unchanged. Whitespace checks passed.

24
research/evaluations/language-replication-02/README.md
View file

@ -42,3 +42,27 @@ correctness or independently authenticate a declared reviewer. Keep initial rati
disagreements and adjudication. A failed pair is excluded from quality counts, and no
score automatically completes human review or M1. Actual execution/editorial outcomes
are recorded here after the authorized run; independent-human scores remain pending.
## Authorized execution outcome — 2026-10-04
Preregistration commit: `1e2741a95909341441da05f86a4b6721eae29b60`, synced before
execution. Twelve attempts were reserved and made once each; **all failed**, with
no retained answers. [Raw records](raw/) retain every reservation and receipt.
[Execution summary](execution-summary.json) records elapsed request time and failed
health checks inside/outside the sandbox. The runner records `InfospaceError`, not
its subtype; endpoint unavailability was verified afterward. Provider execution,
token usage and billing are unknown. No retries were made.
[Availability review](availability-review.json) marks all answers unavailable and
all atomic ratings null. No masked answer review occurred; reading the first receipt
exposed its assignment, which is disclosed. [Comparison summary](comparison-summary.json)
excludes all six pairs. Its zero totals have zero denominators and are inventory
counts, not quality scores or evidence of equivalence. Neither presentation has an
observed result. Original pilot-01 evidence remains unchanged.
The packet and tested execution/scoring tools are usable, but WP-0009 T02 is waiting
for a usable fresh replication. Do not reuse the reserved run identities or modify
the frozen packet. Any future execution needs service restoration, a new preregistered
run identity and explicit fresh authorization. Human validation remains WP-0009 T01;
consumer discovery/integration remains WP-0008. LEARN-0019 retains this failure rather
than dropping it from research history; it contributes no pattern-quality conclusion.

564
research/evaluations/language-replication-02/availability-review.json Normal file
View file

@ -0,0 +1,564 @@
{
"schema_version": 1,
"reviewer": {
"name": "Codex",
"role": "author-model",
"independent_human": false,
"assignment_seen": true,
"prior_scores_seen": false
},
"answers": {
"R02-S01-U": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S01-V": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S02-U": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S02-V": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S03-U": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S03-V": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S04-U": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S04-V": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S05-U": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S05-V": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S06-U": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
},
"R02-S06-V": {
"available": false,
"ratings": {
"A1": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A2": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A3": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A4": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A5": {
"value": null,
"quote": null,
"locator": null,
"reason": null
},
"A6": {
"value": null,
"quote": null,
"locator": null,
"reason": null
}
},
"unsupported_claims": null,
"ambiguity": [
"No retained answer: generation attempt failed. Criteria and unsupported claims remain unreviewed, not zero."
],
"suspected_condition_clues": []
}
}
}

60
research/evaluations/language-replication-02/comparison-summary.json Normal file
View file

@ -0,0 +1,60 @@
{
"schema_version": 1,
"reviewer": {
"name": "Codex",
"role": "author-model",
"independent_human": false,
"assignment_seen": true,
"prior_scores_seen": false
},
"totals": {
"patterns": {
"completed_pairs": 0,
"fulfilled": 0,
"unsafe": 0,
"criteria": 0
},
"prose": {
"completed_pairs": 0,
"fulfilled": 0,
"unsafe": 0,
"criteria": 0
}
},
"pairs": [
{
"scenario": "R02-S01",
"included": false,
"results": {}
},
{
"scenario": "R02-S02",
"included": false,
"results": {}
},
{
"scenario": "R02-S03",
"included": false,
"results": {}
},
{
"scenario": "R02-S04",
"included": false,
"results": {}
},
{
"scenario": "R02-S05",
"included": false,
"results": {}
},
{
"scenario": "R02-S06",
"included": false,
"results": {}
}
],
"limits": [
"Descriptive author-created replication, not proof of superiority/equivalence.",
"Reviewer role is declared provenance; no automatic independent-human or M1 claim."
]
}

19
research/evaluations/language-replication-02/execution-summary.json Normal file
View file

@ -0,0 +1,19 @@
{
"schema_version": 1,
"date": "2026-10-04",
"attempts_reserved": 12,
"completed": 0,
"failed": 12,
"request_elapsed_seconds": 0.059,
"provider_usage_known": false,
"cost_usd": null,
"health_probe": {
"endpoint": "http://127.0.0.1:18081/health",
"sandbox_exit_code": 7,
"host_exit_code": 7,
"result": "Connection refused/unreachable; no inference retry performed"
},
"diagnostic_limit": "Frozen runner retains exception class InfospaceError without subtype; health probes establish endpoint unavailability at inspection, not a provider-side error or proven billing outcome.",
"preregistration_commit": "1e2741a95909341441da05f86a4b6721eae29b60",
"no_retries": true
}

24
research/evaluations/language-replication-02/raw/r01/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r01",
"scenario": "R02-S01",
"condition": "patterns",
"blind_id": "R02-S01-U",
"attempts_reserved": 1,
"prompt_sha256": "91a50e9c1bcb85b650ca7c51155d7c8aed3d8a95f0375a3c87fbcc735b10dde4",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.053,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r01/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r01",
"scenario": "R02-S01",
"condition": "patterns",
"blind_id": "R02-S01-U",
"attempts_reserved": 1,
"prompt_sha256": "91a50e9c1bcb85b650ca7c51155d7c8aed3d8a95f0375a3c87fbcc735b10dde4",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r02/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r02",
"scenario": "R02-S01",
"condition": "prose",
"blind_id": "R02-S01-V",
"attempts_reserved": 1,
"prompt_sha256": "146a74fc4e3adafd8039553a3676102132551faa8168a5a8fcb401d2b205272c",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.001,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r02/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r02",
"scenario": "R02-S01",
"condition": "prose",
"blind_id": "R02-S01-V",
"attempts_reserved": 1,
"prompt_sha256": "146a74fc4e3adafd8039553a3676102132551faa8168a5a8fcb401d2b205272c",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r03/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r03",
"scenario": "R02-S02",
"condition": "prose",
"blind_id": "R02-S02-V",
"attempts_reserved": 1,
"prompt_sha256": "be924ba36625b663e3957b29d30303b8042f5a382cb70b11ea111a2762635dc3",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.0,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r03/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r03",
"scenario": "R02-S02",
"condition": "prose",
"blind_id": "R02-S02-V",
"attempts_reserved": 1,
"prompt_sha256": "be924ba36625b663e3957b29d30303b8042f5a382cb70b11ea111a2762635dc3",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r04/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r04",
"scenario": "R02-S02",
"condition": "patterns",
"blind_id": "R02-S02-U",
"attempts_reserved": 1,
"prompt_sha256": "3371ff49a2d0f29ac8a65a768f72aebf0228fb5bf950494878ec4980c8b1ff70",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.001,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r04/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r04",
"scenario": "R02-S02",
"condition": "patterns",
"blind_id": "R02-S02-U",
"attempts_reserved": 1,
"prompt_sha256": "3371ff49a2d0f29ac8a65a768f72aebf0228fb5bf950494878ec4980c8b1ff70",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r05/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r05",
"scenario": "R02-S03",
"condition": "patterns",
"blind_id": "R02-S03-U",
"attempts_reserved": 1,
"prompt_sha256": "7a61c90e25d342750b3d9651c90b157975e441822d66e826b1315bce957cafe3",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.001,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r05/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r05",
"scenario": "R02-S03",
"condition": "patterns",
"blind_id": "R02-S03-U",
"attempts_reserved": 1,
"prompt_sha256": "7a61c90e25d342750b3d9651c90b157975e441822d66e826b1315bce957cafe3",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r06/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r06",
"scenario": "R02-S03",
"condition": "prose",
"blind_id": "R02-S03-V",
"attempts_reserved": 1,
"prompt_sha256": "76ca0bca70f535da292885af2ead28162daac79e5417b1f92aa68a3d024b7145",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.001,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r06/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r06",
"scenario": "R02-S03",
"condition": "prose",
"blind_id": "R02-S03-V",
"attempts_reserved": 1,
"prompt_sha256": "76ca0bca70f535da292885af2ead28162daac79e5417b1f92aa68a3d024b7145",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r07/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r07",
"scenario": "R02-S04",
"condition": "prose",
"blind_id": "R02-S04-U",
"attempts_reserved": 1,
"prompt_sha256": "d2e369f6381d6bcc769234a870b079eadec29589308c4ad6a8bc4d17ab035311",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.0,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r07/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r07",
"scenario": "R02-S04",
"condition": "prose",
"blind_id": "R02-S04-U",
"attempts_reserved": 1,
"prompt_sha256": "d2e369f6381d6bcc769234a870b079eadec29589308c4ad6a8bc4d17ab035311",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r08/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r08",
"scenario": "R02-S04",
"condition": "patterns",
"blind_id": "R02-S04-V",
"attempts_reserved": 1,
"prompt_sha256": "8705d35a4bc045405986796e6dcd96d687a82b409e6d0208e697bea5c5d207d1",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.0,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r08/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r08",
"scenario": "R02-S04",
"condition": "patterns",
"blind_id": "R02-S04-V",
"attempts_reserved": 1,
"prompt_sha256": "8705d35a4bc045405986796e6dcd96d687a82b409e6d0208e697bea5c5d207d1",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r09/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r09",
"scenario": "R02-S05",
"condition": "patterns",
"blind_id": "R02-S05-U",
"attempts_reserved": 1,
"prompt_sha256": "8944e9bd64680ed927ece8c8e1ad9104b589f5e6b21fa7872ec35e5d728d90c1",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.001,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r09/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r09",
"scenario": "R02-S05",
"condition": "patterns",
"blind_id": "R02-S05-U",
"attempts_reserved": 1,
"prompt_sha256": "8944e9bd64680ed927ece8c8e1ad9104b589f5e6b21fa7872ec35e5d728d90c1",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r10/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r10",
"scenario": "R02-S05",
"condition": "prose",
"blind_id": "R02-S05-V",
"attempts_reserved": 1,
"prompt_sha256": "734d42b631b58b06246db211270c10823100e5e3249964aad286dd9e725d725c",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.0,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r10/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r10",
"scenario": "R02-S05",
"condition": "prose",
"blind_id": "R02-S05-V",
"attempts_reserved": 1,
"prompt_sha256": "734d42b631b58b06246db211270c10823100e5e3249964aad286dd9e725d725c",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r11/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r11",
"scenario": "R02-S06",
"condition": "prose",
"blind_id": "R02-S06-U",
"attempts_reserved": 1,
"prompt_sha256": "c2007173765706f16ed61ff93f1246b960ca31b3cee5b6e511863606f23a6433",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.0,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r11/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r11",
"scenario": "R02-S06",
"condition": "prose",
"blind_id": "R02-S06-U",
"attempts_reserved": 1,
"prompt_sha256": "c2007173765706f16ed61ff93f1246b960ca31b3cee5b6e511863606f23a6433",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

24
research/evaluations/language-replication-02/raw/r12/receipt.json Normal file
View file

@ -0,0 +1,24 @@
{
"run": "r12",
"scenario": "R02-S06",
"condition": "patterns",
"blind_id": "R02-S06-V",
"attempts_reserved": 1,
"prompt_sha256": "b4c71336ea9dd8563db6432e00f1344ebc3379258364f390af73854df89ab432",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400,
"endpoint": "http://127.0.0.1:18081",
"config": {
"model_name": "custodian-triage-balanced",
"temperature": 0.2,
"max_tokens": 1400,
"model_params": {},
"max_depth": 3,
"skip_if_exists": true,
"timeout_seconds": 300
},
"status": "failed",
"error_type": "InfospaceError",
"elapsed_seconds": 0.001,
"responses": []
}

10
research/evaluations/language-replication-02/raw/r12/started.json Normal file
View file

@ -0,0 +1,10 @@
{
"run": "r12",
"scenario": "R02-S06",
"condition": "patterns",
"blind_id": "R02-S06-V",
"attempts_reserved": 1,
"prompt_sha256": "b4c71336ea9dd8563db6432e00f1344ebc3379258364f390af73854df89ab432",
"freeze_sha256": "c674382c1f6399e437794aaaab955168cabe4533ec68b8d4e82af41471d32975",
"max_output_tokens": 1400
}

26
research/evolution/ComparisonWindows.json
View file

@ -194,6 +194,32 @@
"rejection": 0,
"revision": 1
}
},
{
"stream": "cross-stream",
"comparison_group": "presentation-atomic-replication-v2",
"cycle_ids": [
"LEARN-0019"
],
"protocol_refs": [
"research/evolution/cycles/2026-10-04-presentation-replication.md"
],
"cycles_until_review_trigger": 2,
"qualitative_review_due": false,
"positive_effort_cycle_ids": [],
"unknown_effort_cycle_ids": [
"LEARN-0019"
],
"zero_effort_cycle_ids": [],
"effort_complete": false,
"effort_comparison_ready": false,
"outcomes": {
"corroboration": 0,
"inconclusive": 1,
"merge": 0,
"rejection": 0,
"revision": 0
}
}
]
}

27
research/evolution/EvolutionReport.md
View file

@ -52,12 +52,12 @@ Ten selected retrospective outcomes (not a historical census), followed by prosp
| Outcome | Entries (not independent discoveries) |
| --- | ---: |
| corroboration | 5 |
| inconclusive | 0 |
| inconclusive | 1 |
| merge | 0 |
| rejection | 0 |
| revision | 13 |
Cycles with recorded research effort: 7/18. Unknown effort is neither zero nor estimated from commits, tokens or assertion counts.
Cycles with recorded research effort: 7/19. Unknown effort is neither zero nor estimated from commits, tokens or assertion counts.
### Comparison readiness
@ -72,6 +72,7 @@ Declared groups require a review of shared evidence tier, question granularity,
| F / F-navigation-ownership-v1 | 1 | 1 | 0 / 0 | pending | not ready |
| cross-stream / CD-acceptance-projection-static-v1 | 1 | 1 | 0 / 0 | pending | not ready |
| cross-stream / CD-authority-projection-documentary-v1 | 1 | 1 | 0 / 0 | pending | not ready |
| cross-stream / presentation-atomic-replication-v2 | 1 | 0 | 1 / 0 | pending | not ready |
Unknown or zero effort is not dropped to create a favorable window. Qualitative review can retain those cycles, but effort comparisons need an explicitly reviewed window with measured positive research time. No trend or plateau is inferred.
@ -132,6 +133,14 @@ One bounded question counts at most one consequential outcome. Corroboration and
One bounded question counts at most one consequential outcome. Corroboration and inconclusive work remain visible separately. Fewer than three declared cycles: qualitative review trigger pending; no trend assessment.
### Stream cross-stream / presentation-atomic-replication-v2
| Cycle | Protocol | Outcome | Research minutes | Consequential outcome/hour |
| --- | --- | --- | ---: | ---: |
| LEARN-0019 | [protocol](../../research/evolution/cycles/2026-10-04-presentation-replication.md) | inconclusive | unknown | unknown |
One bounded question counts at most one consequential outcome. Corroboration and inconclusive work remain visible separately. Fewer than three declared cycles: qualitative review trigger pending; no trend assessment.
## Coherence and maintainability
Profile hashes and local references passed validation when this report was generated. That checks traceability, not source truth or external URL freshness.
@ -687,3 +696,17 @@ Evidence: [StorageReceiverRecovery](../../research/reviews/StorageReceiverRecove
Remaining uncertainty: Power-loss, device-loss backup, remote durability and arbitrary operation-ID retention remain unverified. No full frontend contract, independent human validation or M1/M2/M3 acceptance. New runtime group is not comparable with static studies; no learning trend.
Supersedes: none recorded.
### LEARN-0019 — Does named organization change constraint/recovery recommendations versus identical guidance under numbered headings on fresh authored variants?
2026-10-04 · stream cross-stream · prospective · inconclusive
Before: Consumed pilot-01 model adjudication scored 18/24 in each condition; naming benefit and equivalence remain unestablished.
Conclusion: The preregistered 12-attempt run produced no retained answers. All six pairs are excluded; no quality comparison or naming conclusion is possible. Endpoint health checks failed inside and outside the sandbox.
Evidence: [execution-summary](../../research/evaluations/language-replication-02/execution-summary.json), [availability-review](../../research/evaluations/language-replication-02/availability-review.json), [README](../../research/evaluations/language-replication-02/README.md).
Remaining uncertainty: No usable generation or empirical rating; failed attempts are not zero scores. Provider usage and billing are unknown; no retries or additional calls authorized. Active research effort unknown; request elapsed time measures failed execution only. Independent human validation and real consumer outcomes remain absent; this new group cannot close a comparable three-cycle window.
Supersedes: none recorded.

5
research/evolution/cycles/2026-10-04-presentation-replication.md
View file

@ -37,3 +37,8 @@ Outcome is recorded after the authorized run in the replication review and LEARN
ledger entry. WP-0009 T01 retains independent human pilot-01 ratings; T03 retains
M1 re-assessment. WP-0008 retains actual consumer decision/outcome evidence. A new
comparison group does not close WP-0006's comparable-window requirement.
Recorded outcome: all twelve attempts failed with no answers; six pairs excluded.
See [execution record](../../evaluations/language-replication-02/README.md).
LEARN-0019 is inconclusive; no empirical comparison or quality change follows.

36
research/evolution/ledger.json
View file

@ -636,6 +636,42 @@
"cost_usd": null
},
"supersedes": []
},
{
"id": "LEARN-0019",
"date": "2026-10-04",
"recording": "prospective",
"stream": "cross-stream",
"comparison_group": "presentation-atomic-replication-v2",
"protocol_ref": "research/evolution/cycles/2026-10-04-presentation-replication.md",
"question": "Does named organization change constraint/recovery recommendations versus identical guidance under numbered headings on fresh authored variants?",
"previous_belief": "Consumed pilot-01 model adjudication scored 18/24 in each condition; naming benefit and equivalence remain unestablished.",
"conclusion": "The preregistered 12-attempt run produced no retained answers. All six pairs are excluded; no quality comparison or naming conclusion is possible. Endpoint health checks failed inside and outside the sandbox.",
"disposition": "inconclusive",
"affected_patterns": [],
"evidence": [
"research/evaluations/language-replication-02/execution-summary.json",
"research/evaluations/language-replication-02/availability-review.json",
"research/evaluations/language-replication-02/README.md"
],
"remaining_uncertainty": [
"No usable generation or empirical rating; failed attempts are not zero scores.",
"Provider usage and billing are unknown; no retries or additional calls authorized.",
"Active research effort unknown; request elapsed time measures failed execution only.",
"Independent human validation and real consumer outcomes remain absent; this new group cannot close a comparable three-cycle window."
],
"reviewer": {
"name": "Codex",
"role": "author-model",
"independent_human": false
},
"effort": {
"research_minutes": null,
"execution_minutes": 0.000983,
"reported_tokens": null,
"cost_usd": null
},
"supersedes": []
}
]
}

1567
research/evolution/snapshots/review-2026-10-04-replication-failure.json Normal file
View file

File diff suppressed because it is too large Load diff

9
research/reviews/M1-SeedReview.md
View file

@ -65,3 +65,12 @@ No candidate promotion, ID rename or evidence-profile upgrade occurs.
These are explicit work records, not a claim that the remaining work was completed
by packaging the reference. The frozen pilot and original investigation receipts are
unchanged. Review this gate again when those tasks deliver new evidence.
## Fresh replication attempt — 2026-10-04
[Replication 02](../evaluations/language-replication-02/README.md) implements six
fresh authored variants, equivalent guidance, atomic criteria and a frozen bounded
runner. All twelve authorized attempts failed without answers; all pairs are excluded.
No empirical scores or independent human evidence were added. M1 stays **revise/defer**;
WP-0009 T01/T02/T03 retain independent review, usable replication and reassessment.

5
tests/test_language_replication.py
View file

@ -56,7 +56,10 @@ def test_tampered_prompt_guidance_or_blank_sheet_is_rejected(packet, path):
def test_no_calls_before_frozen_inputs_are_committed(packet):
with pytest.raises(subprocess.CalledProcessError):
# Before packet publication Git may report a missing path; after publication
# the fresh temporary assignment/freeze differs from HEAD. Both must stop
# execution before adapter construction.
with pytest.raises((subprocess.CalledProcessError, ValueError)):
replication.run(12, packet, lambda: pytest.fail('No adapter before commit verification'))

11
workplans/FEP-WP-0006-language-evolution.md
View file

@ -253,3 +253,14 @@ local links/whitespace passed. [Review snapshot](../research/evolution/snapshots
pins the committed assessment at implementation revision `d8d3a22`; it is a
measurement-review boundary, not an additional empirical cycle. The original
baseline and all previous snapshots are unchanged.
## Retained failed replication cycle — 2026-10-04
LEARN-0019 preregistered at `1e2741a` is an inconclusive attempted presentation
replication in a new protocol group. All twelve attempts failed; no usable answers,
ratings or quality result. Research effort is unknown; request duration is separately
measured. The ledger now has nine prospective attempts/cycles in eight groups,
including this wholly failed run. Largest group remains two, with LEARN-0017 effort
unknown. This failure is retained and cannot establish returns or close T03's
three-cycle prerequisite. WP-0009 T02 owns restoration/future authorized replication.

21
workplans/FEP-WP-0009-m1-independent-validation.md
View file

@ -4,7 +4,7 @@ type: workplan
title: "Obtain independent validation for the M1 seed gate"
domain: infotech
repo: frontend-patterns
status: active
status: blocked
owner: codex
topic_slug: canon
origin: residual
@ -43,7 +43,8 @@ submitted-review-01 worksheet was a model review and does not count.
```task
id: FEP-WP-0009-T02
status: progress
status: wait
blocking_reason: "All 12 authorized attempts failed; llm-connect endpoint unreachable. A future replication requires restored service and fresh explicit execution authorization; no retries allowed."
priority: medium
state_hub_task_id: "8e0ac763-eba4-5625-ad63-af53322bcac4"
```
@ -94,3 +95,19 @@ The user then explicitly authorized **up to 12 calls, 1,400 output tokens per ca
no retries**. This is the fresh replication budget only, not a grant for further model
reviews, autonomous editing, policy changes or human-score substitution. Freeze and
commit the packet/runner before execution; reserve every attempt and retain failures.
## Retained failed replication — 2026-10-04
The preregistered packet/runner was committed and synced at `1e2741a` before
execution. All twelve reserved attempts failed with no retained answer or provider
usage receipt. Both sandbox and host health probes found the configured llm-connect
endpoint unreachable. No call was retried. The budget is conservatively exhausted
as twelve reserved attempts, without claiming twelve provider executions or zero cost.
[Execution record](../research/evaluations/language-replication-02/README.md) retains
all failures, null ratings and six excluded pairs. Packet construction, validation
and bounded execution are implemented; T02 remains wait because no empirical
comparison exists. Future execution needs a new registered packet/run identity and
fresh explicit authorization after service restoration. T01 and T03 retain their
existing gates. LEARN-0019 records one inconclusive attempted cycle, not useful
validation or independent evidence.