Make the sensing loop durable and pin the reserve to Scaleway
The weekday brief only counts when the file is on origin/main. Hub events without git objects are failures. The open-weight SoT moves from the VAULT 850 GiB quota to a dedicated Scaleway bucket (One Zone IA for R, Glacier for S) so V4-Flash and K3 are economically in-scope. Catalogs the real DeepSeek-V4-Flash-0731 (MIT ~167 GiB MoE, not 12B) and nominates Qwen3.8-27B. Bucket create remains FI-WP-0004-T08. Assistant: grok Assistant-Session: 01a09c6a-1cfc-75b1-a78d-c13eaf22241d
This commit is contained in:
parent
8832652ad3
commit
a78187c33e
18 changed files with 1125 additions and 226 deletions
|
|
@ -1,15 +1,16 @@
|
|||
# Collection policy — open-weight reserve
|
||||
|
||||
**Status:** updated for 1 TB NAS + strategic capability reserve (2026-07-24)
|
||||
**Status:** updated for Scaleway object reserve (2026-09-13)
|
||||
**Related:** `schema.yaml`, `docs/backup-storage-policy.md`,
|
||||
`docs/decisions/2026-07-24-nas-strategic-reserve.md`, `INTENT.md`
|
||||
`docs/decisions/2026-09-13-scaleway-object-reserve.md`, `INTENT.md`
|
||||
|
||||
---
|
||||
|
||||
## Purpose
|
||||
|
||||
Decide **what** enters the open-weight reserve, **who** may approve it, and
|
||||
**when** a daily-brief candidate becomes a catalog entry with blobs on the NAS.
|
||||
**when** a daily-brief candidate becomes a catalog entry with blobs on
|
||||
Scaleway (staged locally first).
|
||||
|
||||
---
|
||||
|
||||
|
|
@ -19,7 +20,7 @@ Decide **what** enters the open-weight reserve, **who** may approve it, and
|
|||
need later — **including models too large to run on current lab hardware**
|
||||
* Also hold a **runnable spine** for day-to-day local ops and fine-tunes
|
||||
* Enforce **license and integrity** before download completes
|
||||
* Stay within the **1 TB NAS soft quota (850 GiB)** — quality over mirror volume
|
||||
* Stay within the **€15 / month** soft budget — quality over mirror volume
|
||||
* Prefer official provenance; not a full Hugging Face scrape
|
||||
|
||||
---
|
||||
|
|
@ -32,7 +33,7 @@ Decide **what** enters the open-weight reserve, **who** may approve it, and
|
|||
| **Reserve** | Is this among the best open artifacts worth keeping *just in case*? | **Not gated by current VRAM** |
|
||||
|
||||
**Runnability is not an eligibility gate.** An unrunnable SOTA open MoE can be
|
||||
priority **high** if license and quota allow.
|
||||
priority **high** if license and euro budget allow.
|
||||
|
||||
---
|
||||
|
||||
|
|
@ -42,7 +43,8 @@ priority **high** if license and quota allow.
|
|||
2. **Clear license** — SPDX or linkable license text; `allows_offline_retention: true`
|
||||
3. **Stable provenance** — official org, tagged release, or commit revision
|
||||
4. **Lab rationale** — written `reason` (capability SOTA, runnable spine, embed, FT base, …)
|
||||
5. **Capacity** — estimated size fits under remaining soft quota (850 GiB)
|
||||
5. **Capacity** — estimated monthly storage cost fits under remaining
|
||||
€15 soft budget (Glacier for S, One Zone IA for R)
|
||||
|
||||
Fail any gate → `rejected` or never enter catalog.
|
||||
|
||||
|
|
@ -75,9 +77,9 @@ Catalog field: use `tags` including `tier-r` / `tier-s` / `tier-w` and
|
|||
| -------------------- | -------- |
|
||||
| **< 5 GiB** | Operator or lab agent after license check |
|
||||
| **5–40 GiB** | Explicit operator approval |
|
||||
| **> 40 GiB** | Operator approval + remaining soft-quota check |
|
||||
| **> 200 GiB (typical S giants)** | Operator approval + written note on which other S models may need to wait |
|
||||
| **Any size if quota ≥ 70% used** | Operator approval required |
|
||||
| **> 40 GiB** | Operator approval + remaining **euro-budget** check |
|
||||
| **> 200 GiB (typical S giants)** | Operator approval + written note that the object goes to **Glacier** |
|
||||
| **Any size if month ≥ 70% of €15** | Operator approval required |
|
||||
| **Unclear license or ToS risk** | Do not collect; `rejected` |
|
||||
|
||||
Agents may **nominate** freely; they **collect** only in the < 5 GiB band with
|
||||
|
|
@ -97,8 +99,9 @@ unambiguous licenses unless the operator has approved the catalog entry.
|
|||
|
||||
* **Best available open general / reasoning / code weights** at the frontier of open
|
||||
* Large MoE or dense models even if current infra cannot serve them
|
||||
* Prefer official compressed releases (FP8, published quant) when full precision
|
||||
would exhaust the 1 TB NAS
|
||||
* Prefer official compressed releases (FP8, published quant) when full
|
||||
precision would blow the euro budget; Glacier makes full official trees
|
||||
of the *top* S identities affordable (V4-Flash ~€0.42/mo, K3 ~€3.69/mo)
|
||||
* One clear “best open” per capability niche is better than five near-duplicates
|
||||
|
||||
### Companions
|
||||
|
|
@ -124,7 +127,7 @@ Tokenizers, LoRA adapters, small eval fixtures when required to use a reserved b
|
|||
brief nominates
|
||||
→ candidate
|
||||
→ approved
|
||||
→ collecting (NAS staging/)
|
||||
→ collecting (local staging/ then S3 upload)
|
||||
→ collected
|
||||
→ verified
|
||||
→ superseded|evicted
|
||||
|
|
@ -136,14 +139,15 @@ brief nominates
|
|||
|
||||
1. Brief **Collection candidates** nominates R/S/W.
|
||||
2. Catalog YAML under `inventory/catalog/`.
|
||||
3. Download only after storage path is pinned (`docs/backup-storage-policy.md`) and approval rules pass.
|
||||
3. Download only after the Scaleway bucket is live (FI-WP-0004-T08) and
|
||||
approval rules pass. Stage on VAULT; SoT is `s3://`.
|
||||
4. `collection.brief_refs` / research refs for provenance of the nomination.
|
||||
|
||||
---
|
||||
|
||||
## Eviction rule of thumb
|
||||
|
||||
When over soft quota:
|
||||
When over the euro soft budget:
|
||||
|
||||
1. **W** tier and easily re-obtainable duplicates
|
||||
2. Superseded revisions with a stronger verified successor
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue