coulomb/freedom-intelligence
4
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Register reserve under agents hub and pin VAULT storage.

Browse source 
Classify freedom-intelligence for State Hub (agents domain), sync FI-WP-0001..0003 with hub IDs, enrich catalog entries with profile/SWOT, and pin the open-weight reserve to D:\vault\coulomb\freedom-intelligence\ with strategic S-tier policy.
This commit is contained in:
tegwick 2026-07-28 00:25:21 +02:00
parent 00f469662b
commit a83ef0a79a
29 changed files with 1343 additions and 279 deletions
Download patch file Download diff file Expand all files Collapse all files

57
docs/hardware-envelope.md
View file

@ -1,28 +1,47 @@
# Hardware envelope — homelab accessible (draft)
# Hardware envelope — run vs reserve
**Status:** assumptions + TBD measurements
**Used by:** inventory `hardware_class`, axis B/C prioritization, collection size decisions
**Status:** updated 2026-07-24 (1 TB NAS strategic reserve)
**Used by:** inventory `hardware_class`, axis B/C, collection tiers R/S
---
## Purpose
Define what Freedom Intelligence means by **homelab accessible** so we do not
collect models that only make sense on hyperscale clusters.
Separate two questions that used to be conflated:
1. **What can we run or fine-tune now?** → *run envelope*
2. **What should we store on the NAS just in case?** → *reserve envelope* (1 TB)
Collecting a model **does not** require it to fit the run envelope.
See `docs/decisions/2026-07-24-nas-strategic-reserve.md`.
---
## Working tiers (until hosts are measured)
## Run envelope (inference / training *today*)
| Tier | Assumed capacity | Target model class |
| ---- | ---------------- | ------------------ |
| Tier | Assumed capacity | Typical runnable class |
| ---- | ---------------- | ---------------------- |
| **T0 — CPU / edge** | 16–64 GB system RAM, no GPU | ≤3B Q4; embeddings ≤0.5B |
| **T1 — consumer GPU** | 8–12 GB VRAM | 7–8B Q4/Q5; 3B fp16 |
| **T2 — enthusiast GPU** | 16–24 GB VRAM | 14B Q4; 8B fp16; light 32B Q4 |
| **T3 — lab multi-GPU** | 2×24 GB+ or 48 GB+ | 32B fp16 / 70B Q4; small MoE |
| **T4 — out of envelope** | multi-node / 8×A100-class | Full DeepSeek-V3 MoE — P2 watch only |
| **T4 — beyond current lab** | multi-node / datacenter class | Full large MoE / 70B+ fp16 dense |
P0 collection targets **T0–T2**. P2 full MoE is **T4**.
**Runnable spine (tier R)** targets **T0–T2** (stretch T3 when hardware exists).
**Strategic reserve (tier S)** may be **T3–T4 or above** for *execution* — still
valid for NAS collection.
---
## Reserve envelope (NAS)
| Parameter | Value |
| --------- | ----- |
| Facility | VAULT HD `D:\vault\coulomb\freedom-intelligence\` (soft quota 850 GiB) |
| Soft quota | 850 GiB |
| Hard stop | 920 GiB |
| Policy | `docs/backup-storage-policy.md` |
---
@ -30,13 +49,14 @@ P0 collection targets **T0–T2**. P2 full MoE is **T4**.
| Host | Role | GPU | VRAM | RAM | Notes |
| ---- | ---- | --- | ---- | --- | ----- |
| TBD | primary local inference | TBD | TBD | TBD | |
| TBD | training experiments | TBD | TBD | TBD | |
| railiance01 | cluster (not weight store) | n/a | n/a | n/a | Prefer not to fill hot disks with weights |
| TBD | primary local inference | TBD | TBD | TBD | Run envelope |
| TBD | training experiments | TBD | TBD | TBD | Run envelope |
| **VAULT HD (D:)** | weight store | n/a | n/a | n/a | **Reserve envelope** — soft 850 GiB |
| railiance01 | cluster | n/a | n/a | n/a | Do not store weight trees on hot disks |
---
## Inference runtime defaults (intent)
## Inference runtime defaults (when runnable)
| Runtime | When |
| ------- | ---- |
@ -45,16 +65,18 @@ P0 collection targets **T0–T2**. P2 full MoE is **T4**.
| MLX | Apple silicon if present |
| Ollama | Quick operator UX only |
Strategic giants may remain **cold storage only** until hardware upgrades.
---
## Training defaults (intent)
## Training defaults (when runnable)
| Method | Envelope |
| ------ | -------- |
| QLoRA 7–8B | T1–T2 |
| QLoRA 14B | T2 |
| Full FT 7B | T2–T3 |
| 70B+ FT | T3+ only with explicit plan |
| 70B+ / large MoE FT | Future facility — weights may already sit on NAS |
---
@ -62,4 +84,5 @@ P0 collection targets **T0–T2**. P2 full MoE is **T4**.
| Date | Change |
| ---- | ------ |
| 2026-07-24 | Draft tiers; host table empty |
| 2026-07-24 | Draft tiers |
| 2026-07-24 | Split run vs reserve; NAS 1 TB; S tier may exceed run envelope |