tegwick
a83ef0a79a
Classify freedom-intelligence for State Hub (agents domain), sync FI-WP-0001..0003 with hub IDs, enrich catalog entries with profile/SWOT, and pin the open-weight reserve to D:\vault\coulomb\freedom-intelligence\ with strategic S-tier policy.
88 lines
2.6 KiB
Markdown
88 lines
2.6 KiB
Markdown
# Hardware envelope — run vs reserve
|
||
|
||
**Status:** updated 2026-07-24 (1 TB NAS strategic reserve)
|
||
**Used by:** inventory `hardware_class`, axis B/C, collection tiers R/S
|
||
|
||
---
|
||
|
||
## Purpose
|
||
|
||
Separate two questions that used to be conflated:
|
||
|
||
1. **What can we run or fine-tune now?** → *run envelope*
|
||
2. **What should we store on the NAS just in case?** → *reserve envelope* (1 TB)
|
||
|
||
Collecting a model **does not** require it to fit the run envelope.
|
||
See `docs/decisions/2026-07-24-nas-strategic-reserve.md`.
|
||
|
||
---
|
||
|
||
## Run envelope (inference / training *today*)
|
||
|
||
| Tier | Assumed capacity | Typical runnable class |
|
||
| ---- | ---------------- | ---------------------- |
|
||
| **T0 — CPU / edge** | 16–64 GB system RAM, no GPU | ≤3B Q4; embeddings ≤0.5B |
|
||
| **T1 — consumer GPU** | 8–12 GB VRAM | 7–8B Q4/Q5; 3B fp16 |
|
||
| **T2 — enthusiast GPU** | 16–24 GB VRAM | 14B Q4; 8B fp16; light 32B Q4 |
|
||
| **T3 — lab multi-GPU** | 2×24 GB+ or 48 GB+ | 32B fp16 / 70B Q4; small MoE |
|
||
| **T4 — beyond current lab** | multi-node / datacenter class | Full large MoE / 70B+ fp16 dense |
|
||
|
||
**Runnable spine (tier R)** targets **T0–T2** (stretch T3 when hardware exists).
|
||
|
||
**Strategic reserve (tier S)** may be **T3–T4 or above** for *execution* — still
|
||
valid for NAS collection.
|
||
|
||
---
|
||
|
||
## Reserve envelope (NAS)
|
||
|
||
| Parameter | Value |
|
||
| --------- | ----- |
|
||
| Facility | VAULT HD `D:\vault\coulomb\freedom-intelligence\` (soft quota 850 GiB) |
|
||
| Soft quota | 850 GiB |
|
||
| Hard stop | 920 GiB |
|
||
| Policy | `docs/backup-storage-policy.md` |
|
||
|
||
---
|
||
|
||
## Lab hosts (fill in)
|
||
|
||
| Host | Role | GPU | VRAM | RAM | Notes |
|
||
| ---- | ---- | --- | ---- | --- | ----- |
|
||
| TBD | primary local inference | TBD | TBD | TBD | Run envelope |
|
||
| TBD | training experiments | TBD | TBD | TBD | Run envelope |
|
||
| **VAULT HD (D:)** | weight store | n/a | n/a | n/a | **Reserve envelope** — soft 850 GiB |
|
||
| railiance01 | cluster | n/a | n/a | n/a | Do not store weight trees on hot disks |
|
||
|
||
---
|
||
|
||
## Inference runtime defaults (when runnable)
|
||
|
||
| Runtime | When |
|
||
| ------- | ---- |
|
||
| llama.cpp / GGUF | Desktop & edge |
|
||
| vLLM | Server multi-request |
|
||
| MLX | Apple silicon if present |
|
||
| Ollama | Quick operator UX only |
|
||
|
||
Strategic giants may remain **cold storage only** until hardware upgrades.
|
||
|
||
---
|
||
|
||
## Training defaults (when runnable)
|
||
|
||
| Method | Envelope |
|
||
| ------ | -------- |
|
||
| QLoRA 7–8B | T1–T2 |
|
||
| QLoRA 14B | T2 |
|
||
| Full FT 7B | T2–T3 |
|
||
| 70B+ / large MoE FT | Future facility — weights may already sit on NAS |
|
||
|
||
---
|
||
|
||
## Pin log
|
||
|
||
| Date | Change |
|
||
| ---- | ------ |
|
||
| 2026-07-24 | Draft tiers |
|
||
| 2026-07-24 | Split run vs reserve; NAS 1 TB; S tier may exceed run envelope |
|