mirror of https://github.com/huggingface/diffusers.git synced 2026-01-27 17:22:53 +03:00

Files

Aryan 9a147b82f7 Module Group Offloading (#10503 )

* update

* fix

* non_blocking; handle parameters and buffers

* update

* Group offloading with cuda stream prefetching (#10516)

* cuda stream prefetch

* remove breakpoints

* update

* copy model hook implementation from pab

* update; ~very workaround based implementation but it seems to work as expected; needs cleanup and rewrite

* more workarounds to make it actually work

* cleanup

* rewrite

* update

* make sure to sync current stream before overwriting with pinned params

not doing so will lead to erroneous computations on the GPU and cause bad results

* better check

* update

* remove hook implementation to not deal with merge conflict

* re-add hook changes

* why use more memory when less memory do trick

* why still use slightly more memory when less memory do trick

* optimise

* add model tests

* add pipeline tests

* update docs

* add layernorm and groupnorm

* address review comments

* improve tests; add docs

* improve docs

* Apply suggestions from code review

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* apply suggestions from code review

* update tests

* apply suggestions from review

* enable_group_offloading -> enable_group_offload for naming consistency

* raise errors if multiple offloading strategies used; add relevant tests

* handle .to() when group offload applied

* refactor some repeated code

* remove unintentional change from merge conflict

* handle .cuda()

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

2025-02-14 12:59:45 +05:30

1.2 KiB

Raw Blame History

Utilities

Utility and helper functions for working with 🤗 Diffusers.

numpy_to_pil

autodoc utils.numpy_to_pil

pt_to_pil

autodoc utils.pt_to_pil

load_image

autodoc utils.load_image

export_to_gif

autodoc utils.export_to_gif

export_to_video

autodoc utils.export_to_video

make_image_grid

autodoc utils.make_image_grid

randn_tensor

autodoc utils.torch_utils.randn_tensor

apply_layerwise_casting

autodoc hooks.layerwise_casting.apply_layerwise_casting

apply_group_offloading

autodoc hooks.group_offloading.apply_group_offloading

1.2 KiB Raw Blame History