tegwick
a83ef0a79a
Classify freedom-intelligence for State Hub (agents domain), sync FI-WP-0001..0003 with hub IDs, enrich catalog entries with profile/SWOT, and pin the open-weight reserve to D:\vault\coulomb\freedom-intelligence\ with strategic S-tier policy.
2.6 KiB
2.6 KiB
Hardware envelope — run vs reserve
Status: updated 2026-07-24 (1 TB NAS strategic reserve)
Used by: inventory hardware_class, axis B/C, collection tiers R/S
Purpose
Separate two questions that used to be conflated:
- What can we run or fine-tune now? → run envelope
- What should we store on the NAS just in case? → reserve envelope (1 TB)
Collecting a model does not require it to fit the run envelope.
See docs/decisions/2026-07-24-nas-strategic-reserve.md.
Run envelope (inference / training today)
| Tier | Assumed capacity | Typical runnable class |
|---|---|---|
| T0 — CPU / edge | 16–64 GB system RAM, no GPU | ≤3B Q4; embeddings ≤0.5B |
| T1 — consumer GPU | 8–12 GB VRAM | 7–8B Q4/Q5; 3B fp16 |
| T2 — enthusiast GPU | 16–24 GB VRAM | 14B Q4; 8B fp16; light 32B Q4 |
| T3 — lab multi-GPU | 2×24 GB+ or 48 GB+ | 32B fp16 / 70B Q4; small MoE |
| T4 — beyond current lab | multi-node / datacenter class | Full large MoE / 70B+ fp16 dense |
Runnable spine (tier R) targets T0–T2 (stretch T3 when hardware exists).
Strategic reserve (tier S) may be T3–T4 or above for execution — still valid for NAS collection.
Reserve envelope (NAS)
| Parameter | Value |
|---|---|
| Facility | VAULT HD D:\vault\coulomb\freedom-intelligence\ (soft quota 850 GiB) |
| Soft quota | 850 GiB |
| Hard stop | 920 GiB |
| Policy | docs/backup-storage-policy.md |
Lab hosts (fill in)
| Host | Role | GPU | VRAM | RAM | Notes |
|---|---|---|---|---|---|
| TBD | primary local inference | TBD | TBD | TBD | Run envelope |
| TBD | training experiments | TBD | TBD | TBD | Run envelope |
| VAULT HD (D:) | weight store | n/a | n/a | n/a | Reserve envelope — soft 850 GiB |
| railiance01 | cluster | n/a | n/a | n/a | Do not store weight trees on hot disks |
Inference runtime defaults (when runnable)
| Runtime | When |
|---|---|
| llama.cpp / GGUF | Desktop & edge |
| vLLM | Server multi-request |
| MLX | Apple silicon if present |
| Ollama | Quick operator UX only |
Strategic giants may remain cold storage only until hardware upgrades.
Training defaults (when runnable)
| Method | Envelope |
|---|---|
| QLoRA 7–8B | T1–T2 |
| QLoRA 14B | T2 |
| Full FT 7B | T2–T3 |
| 70B+ / large MoE FT | Future facility — weights may already sit on NAS |
Pin log
| Date | Change |
|---|---|
| 2026-07-24 | Draft tiers |
| 2026-07-24 | Split run vs reserve; NAS 1 TB; S tier may exceed run envelope |