feat: `--stream-layers` for streaming weights from CPU during generation#1576

Merged

leejet merged 15 commits into

leejet:masterfrom

fszontagh:feature/unified-streaming

Jun 2, 2026

Commits on May 29, 2026

Foundation: add --stream-layers flag, planner annotation, layer registry
fszontagh
committed
chunk-K residency, multi-runner safety, and LoRA correctness fallbacks
fszontagh
committed
Snapshot+restore persistent EXTERNAL inputs so runtime LoRA scales correctly
fszontagh
committed

Commits on May 31, 2026

Model active segment footprint in annotate_residency
fszontagh
committed
Drop async prefetch path and consolidate residency annotation
fszontagh
committed
Merge remote-tracking branch 'upstream/master' into feature/unified-streaming
fszontagh
committed