Skip to content

refactor: centralize runner weight staging and cleanup#1644

Merged
leejet merged 2 commits into
masterfrom
model_manager
Jun 13, 2026
Merged

refactor: centralize runner weight staging and cleanup#1644
leejet merged 2 commits into
masterfrom
model_manager

Conversation

@leejet

@leejet leejet commented Jun 13, 2026

Copy link
Copy Markdown
Owner

Summary

  • Add a shared runtime weight manager for lazy parameter loading, staging to compute backends, LoRA application, and release.
  • Wire runners, conditioners, extensions, VAE/audio VAE/control paths, and graph-cut execution through the new manager and runner_done() lifecycle.
  • Split compute cleanup controls into auto_free, free_compute_buffer, and free_compute_params.
  • Update graph-cut max-vram merging/residency handling and switch model-loading progress fill to #.

Related Issue / Discussion

N/A

Additional Information

N/A

Checklist

@leejet leejet merged commit 563137a into master Jun 13, 2026
14 checks passed
@leejet leejet deleted the model_manager branch June 13, 2026 18:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant