tegwick b5f911140b Establish Freedom Intelligence lab foundation and baseline research.

Add INTENT/SCOPE, daily-brief playbook, activity-core definition (disabled),
workplans FI-WP-0001..0003, baseline field survey with open-weight collection
recommendations, and inventory catalog candidates for the model reserve.

2026-07-24 00:15:27 +02:00

1.8 KiB

Raw Blame History

Hardware envelope — homelab accessible (draft)

Status: assumptions + TBD measurements
Used by: inventory hardware_class, axis B/C prioritization, collection size decisions

Purpose

Define what Freedom Intelligence means by homelab accessible so we do not collect models that only make sense on hyperscale clusters.

Working tiers (until hosts are measured)

Tier	Assumed capacity	Target model class
T0 — CPU / edge	16–64 GB system RAM, no GPU	≤3B Q4; embeddings ≤0.5B
T1 — consumer GPU	8–12 GB VRAM	7–8B Q4/Q5; 3B fp16
T2 — enthusiast GPU	16–24 GB VRAM	14B Q4; 8B fp16; light 32B Q4
T3 — lab multi-GPU	2×24 GB+ or 48 GB+	32B fp16 / 70B Q4; small MoE
T4 — out of envelope	multi-node / 8×A100-class	Full DeepSeek-V3 MoE — P2 watch only

P0 collection targets T0–T2. P2 full MoE is T4.

Lab hosts (fill in)

Host	Role	GPU	VRAM	RAM	Notes
TBD	primary local inference	TBD	TBD	TBD
TBD	training experiments	TBD	TBD	TBD
railiance01	cluster (not weight store)	n/a	n/a	n/a	Prefer not to fill hot disks with weights

Inference runtime defaults (intent)

Runtime	When
llama.cpp / GGUF	Desktop & edge
vLLM	Server multi-request
MLX	Apple silicon if present
Ollama	Quick operator UX only

Training defaults (intent)

Method	Envelope
QLoRA 7–8B	T1–T2
QLoRA 14B	T2
Full FT 7B	T2–T3
70B+ FT	T3+ only with explicit plan

Pin log

Date	Change
2026-07-24	Draft tiers; host table empty

1.8 KiB Raw Blame History Unescape Escape