coulomb/frontend-patterns
5
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Record first authority investigation and preserve failed live-run evidence

Browse source 
Assistant: codex
Assistant-Model: gpt-6-astra
Assistant-Session: 01a0cffe-206f-7323-89d3-b20ca4cf4bf9
This commit is contained in:
tegwick 2026-09-24 15:43:59 +02:00
parent 0839ec0600
commit 1f95f6389a
13 changed files with 268 additions and 79 deletions
Download patch file Download diff file Expand all files Collapse all files

19
research/bench/README.md
View file

@ -99,14 +99,14 @@ provider call was made during setup.
| Investigation | Input readiness | Work record |
| --- | --- | --- |
| Carniato first source case | SRC-0001 verified; bounded authority/feedback workspace prepared | FEP-WP-0002-T02 |
| Contrasting local-first source | SRC-0002 verified; bounded authority workspace prepared | FEP-WP-0002-T02 |
| Carniato first source case | Initial manual review recorded; provider attempt failed | FEP-WP-0002-T02 |
| Contrasting local-first source | Initial manual review recorded; provider attempt failed | FEP-WP-0002-T02 |
| VC-01 and VC-02 synthesis | Depends on reviewed source claims and candidate patterns | FEP-WP-0002-T03 |
Do not ingest the existing Carniato research stub as if it were the original article.
Prepared primary-source plans (four calls each; not yet executed):
Primary-source plans (four calls each; each run failed on its first call):
```bash
../infospace-bench/.venv/bin/python scripts/research_bench.py plan research/bench/infospaces/carniato-authority-01
@ -115,3 +115,16 @@ Prepared primary-source plans (four calls each; not yet executed):
These short packets isolate the first comparison question. They do not substitute
for full source review, independent known uses or the two architecture walkthroughs.
## Live pilot outcome — 2026-09-24
Both primary-source runs attempted Gemini 2.5 Flash through OpenRouter and failed
before producing research artifacts. A separate credential probe returned HTTP 401.
Their failed receipts remain immutable. Read [AuthorityPilot](../reviews/AuthorityPilot.md)
for the manual review that continued independently. New runs require a working
credential authorized for this client and fresh workspace slugs.
Failure receipts now capture adapter/model and safe structured diagnostic fields;
raw provider error bodies, headers and credential values are never persisted.
The initial failed receipts predate this improvement; the review records their model.

26
research/bench/infospaces/carniato-authority-01/reports/research-run.json Normal file
View file

@ -0,0 +1,26 @@
{
"root": "/home/worsch/frontend-patterns/research/bench/infospaces/carniato-authority-01",
"workflow": "frontend-source-investigation",
"source_sha256": "a4ef36bb7d4530106cde8b85281e88c7632e9a28d9f0596cda2f405442d80888",
"evidence_kind": "primary",
"stages": [
"claims",
"candidates",
"relations",
"critique"
],
"provider_calls": 4,
"cost_usd": "unknown; call limit is not a dollar budget",
"review_status": "unreviewed",
"input_digests": {
"infospace.yaml": "0f52be84e24f426e5851f905c462c2ca959f08d528b187b58e84a6170e683952",
"profile/templates/candidates.md": "a1b101ec9ad8727be0cfb4b495eaa07b8715b21e5fb089ff3bbf3378d97ab592",
"profile/templates/claims.md": "1dbaea092a7d2e5acbf5e0ef0a2a7caa3d1b3ee7a84196d47e34a10b2514fae7",
"profile/templates/critique.md": "c8da28d03ae204324136c2f26f0602fdb43fdc2a360f0b305493b96502d934cf",
"profile/templates/relations.md": "159310e2b63d84fe67e0866f79c12099232a1b45c7c5e09793a3767a0a03ebe4",
"profile/workflow.yaml": "e0f3075dc9d896369dd45dc4da3577eb314cb4ef0e4414f905af68ec77cf5b72"
},
"status": "failed",
"error_type": "InfospaceError",
"provider_calls_attempted": 1
}

26
research/bench/infospaces/local-first-authority-01/reports/research-run.json Normal file
View file

@ -0,0 +1,26 @@
{
"root": "/home/worsch/frontend-patterns/research/bench/infospaces/local-first-authority-01",
"workflow": "frontend-source-investigation",
"source_sha256": "c32ea4843ba1be9a2da7ef90e4b6dffab26f106a33dd881aee6048b6c3d027f7",
"evidence_kind": "primary",
"stages": [
"claims",
"candidates",
"relations",
"critique"
],
"provider_calls": 4,
"cost_usd": "unknown; call limit is not a dollar budget",
"review_status": "unreviewed",
"input_digests": {
"infospace.yaml": "4e5a557c5f9e8a3e7c38bb578aa58d6336791bd241ecb84fc58164f3795d8889",
"profile/templates/candidates.md": "a1b101ec9ad8727be0cfb4b495eaa07b8715b21e5fb089ff3bbf3378d97ab592",
"profile/templates/claims.md": "1dbaea092a7d2e5acbf5e0ef0a2a7caa3d1b3ee7a84196d47e34a10b2514fae7",
"profile/templates/critique.md": "c8da28d03ae204324136c2f26f0602fdb43fdc2a360f0b305493b96502d934cf",
"profile/templates/relations.md": "159310e2b63d84fe67e0866f79c12099232a1b45c7c5e09793a3767a0a03ebe4",
"profile/workflow.yaml": "e0f3075dc9d896369dd45dc4da3577eb314cb4ef0e4414f905af68ec77cf5b72"
},
"status": "failed",
"error_type": "InfospaceError",
"provider_calls_attempted": 1
}