Register reserve under agents hub and pin VAULT storage.
Classify freedom-intelligence for State Hub (agents domain), sync FI-WP-0001..0003 with hub IDs, enrich catalog entries with profile/SWOT, and pin the open-weight reserve to D:\vault\coulomb\freedom-intelligence\ with strategic S-tier policy.
This commit is contained in:
parent
00f469662b
commit
a83ef0a79a
29 changed files with 1343 additions and 279 deletions
|
|
@ -216,12 +216,19 @@ Freedom Intelligence **reports** on harness tech; it does not replace sand-boxer
|
|||
| 10 | Code embed: `nomic-ai/nomic-embed-code` or Jina code embed | Code RAG for repos |
|
||||
| 11 | Small reranker: `BAAI/bge-reranker-v2-m3` | Cheap quality win for RAG |
|
||||
|
||||
### 6.4 P2 — watch / large (candidate or docs only)
|
||||
### 6.4 Strategic large (updated 2026-07-24)
|
||||
|
||||
**Superseded by operator decision:** 1 TB local NAS + capability-first reserve.
|
||||
Full DeepSeek-V3/R1-class and 70B dense opens **are in scope** even if unrunnable
|
||||
on current GPUs. See:
|
||||
|
||||
- `docs/decisions/2026-07-24-nas-strategic-reserve.md`
|
||||
- `research/2026-07-24-nas-strategic-collection-plan.md`
|
||||
|
||||
| Item | Guidance |
|
||||
| ---- | -------- |
|
||||
| Full **DeepSeek-V3 / R1** MoE (~600B+ class, hundreds of GB even quantized) | **Do not auto-collect.** Separate capacity + multi-GPU decision |
|
||||
| **Llama 70B / Qwen 72B** class | Only if lab gains multi-GPU and clear offline need |
|
||||
| Full **DeepSeek-V3 / R1** class | **Strategic (S)** — collect under 850 GiB soft quota; prefer official compressed if needed |
|
||||
| **Llama 70B / Qwen 72B** class | **Strategic (S)** dense — good second fill after one primary MoE |
|
||||
| Every new quant repack on HF | Skip; track base official only |
|
||||
|
||||
### 6.5 Explicit non-recommendations (for now)
|
||||
|
|
|
|||
94
research/2026-07-24-nas-strategic-collection-plan.md
Normal file
94
research/2026-07-24-nas-strategic-collection-plan.md
Normal file
|
|
@ -0,0 +1,94 @@
|
|||
# NAS strategic collection plan (1 TB)
|
||||
|
||||
**Date:** 2026-07-24
|
||||
**Decision:** `docs/decisions/2026-07-24-nas-strategic-reserve.md`
|
||||
**Soft quota:** 850 GiB on 1 TB local NAS
|
||||
|
||||
---
|
||||
|
||||
## Intent
|
||||
|
||||
Capture the **most capable open-weight models** for long-term optionality, **even
|
||||
if they cannot run on current lab GPUs**, plus keep a **runnable spine** for
|
||||
daily local use.
|
||||
|
||||
---
|
||||
|
||||
## Tier R — runnable spine (keep resident)
|
||||
|
||||
| Model | Est. (Q4 / fp16) | Role |
|
||||
| ----- | ---------------- | ---- |
|
||||
| Qwen3-8B | ~5 / ~16 GiB | Default instruct + FT |
|
||||
| Llama-3.2-3B-Instruct | ~2 / ~6 GiB | Edge |
|
||||
| BGE-M3 | ~2 GiB | Multilingual embed |
|
||||
| DeepSeek-R1-Distill-Qwen-14B | ~9 / ~28 GiB | Local reason |
|
||||
| nomic-embed-text-v1.5 | <1 GiB | Light embed |
|
||||
| **Subtotal (quant-first)** | **~20–30 GiB** | |
|
||||
| **Subtotal (fp16-ish)** | **~50–55 GiB** | |
|
||||
|
||||
---
|
||||
|
||||
## Tier S — strategic capability (best open, may be unrunnable)
|
||||
|
||||
Prioritize **one primary artifact per capability niche** so 1 TB is not wasted
|
||||
on near-duplicates. Prefer official compressed weights when full precision is
|
||||
hundreds of GiB–TB.
|
||||
|
||||
| Priority | Capability niche | Representative targets (verify current HF id + license at pull) | Size class (order of magnitude) |
|
||||
| -------- | ---------------- | ---------------------------------------------------------------- | -------------------------------- |
|
||||
| **S1** | Best open general / MoE chat | DeepSeek-V3 / V3.2 / V4-class open MoE (latest card) | ~300–700+ GiB depending on quant/precision |
|
||||
| **S2** | Best open reasoner | DeepSeek-R1 full (or successor open reasoner) | similar large |
|
||||
| **S3** | Best open coding / SWE open weight | Top open code MoE or dense (e.g. GLM-5.x open, Qwen coder large — pick current SOTA open) | tens–hundreds GiB |
|
||||
| **S4** | Strong open dense mid-large | Qwen3-72B or Llama 3.3 70B / Llama 4 open text variant | ~40–150 GiB quant / larger fp |
|
||||
| **S5** | Efficient open frontier family | Gemma 4 large open variants | tens of GiB |
|
||||
|
||||
**1 TB portfolio rule of thumb**
|
||||
|
||||
```text
|
||||
R spine (~30–55 GiB)
|
||||
+ S1 one primary giant quant (~300–450 GiB) ← first strategic fill
|
||||
+ optional S4 dense 70B (~40–80 GiB Q4)
|
||||
+ embeds already in R
|
||||
+ staging headroom
|
||||
≈ 400–600 GiB typical first strategic fill
|
||||
```
|
||||
|
||||
If a single full-precision S1 would exceed soft quota alone, **take the best
|
||||
official compressed release** of that model and record the base id as the
|
||||
capability identity.
|
||||
|
||||
**Do not** try to store S1 + S2 + S3 all at full precision on this NAS.
|
||||
|
||||
---
|
||||
|
||||
## Tier W — optional (quota permitting)
|
||||
|
||||
* Qwen3-14B, R1-Distill-32B, BGE reranker (already catalog medium)
|
||||
* Extra quants of models already held in another format
|
||||
* Code-specific embeds
|
||||
|
||||
---
|
||||
|
||||
## Explicitly out
|
||||
|
||||
* Closed API-only weights
|
||||
* Full HF org mirrors
|
||||
* Multiple anonymous “uncensored” reuploads of the same base
|
||||
|
||||
---
|
||||
|
||||
## Download order (recommended)
|
||||
|
||||
1. Pin mount path in backup-storage-policy (done 2026-07-28: `D:\vault\coulomb\freedom-intelligence\`)
|
||||
2. **R spine** (fast wins, unblocks local work)
|
||||
3. **S1** — single best open general MoE (compressed if needed)
|
||||
4. Reassess free space
|
||||
5. **S4** or **S2** next depending on which niche matters more for Coulomb
|
||||
6. W-tier only with ≥200 GiB free under soft quota
|
||||
|
||||
---
|
||||
|
||||
## Catalog
|
||||
|
||||
R and selected S/W candidates live under `inventory/catalog/`. Strategic S
|
||||
entries use tags `tier-s`, `strategic`, `beyond-run-envelope`.
|
||||
Loading…
Add table
Add a link
Reference in a new issue