mirror of
https://github.com/huggingface/diffusers.git
synced 2026-01-27 17:22:53 +03:00
9a147b82f7
* update * fix * non_blocking; handle parameters and buffers * update * Group offloading with cuda stream prefetching (#10516) * cuda stream prefetch * remove breakpoints * update * copy model hook implementation from pab * update; ~very workaround based implementation but it seems to work as expected; needs cleanup and rewrite * more workarounds to make it actually work * cleanup * rewrite * update * make sure to sync current stream before overwriting with pinned params not doing so will lead to erroneous computations on the GPU and cause bad results * better check * update * remove hook implementation to not deal with merge conflict * re-add hook changes * why use more memory when less memory do trick * why still use slightly more memory when less memory do trick * optimise * add model tests * add pipeline tests * update docs * add layernorm and groupnorm * address review comments * improve tests; add docs * improve docs * Apply suggestions from code review Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * apply suggestions from code review * update tests * apply suggestions from review * enable_group_offloading -> enable_group_offload for naming consistency * raise errors if multiple offloading strategies used; add relevant tests * handle .to() when group offload applied * refactor some repeated code * remove unintentional change from merge conflict * handle .cuda() --------- Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
52 lines
1.2 KiB
Markdown
52 lines
1.2 KiB
Markdown
<!--Copyright 2024 The HuggingFace Team. All rights reserved.
|
|
|
|
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
|
|
the License. You may obtain a copy of the License at
|
|
|
|
http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
|
|
an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
|
|
specific language governing permissions and limitations under the License.
|
|
-->
|
|
|
|
# Utilities
|
|
|
|
Utility and helper functions for working with 🤗 Diffusers.
|
|
|
|
## numpy_to_pil
|
|
|
|
[[autodoc]] utils.numpy_to_pil
|
|
|
|
## pt_to_pil
|
|
|
|
[[autodoc]] utils.pt_to_pil
|
|
|
|
## load_image
|
|
|
|
[[autodoc]] utils.load_image
|
|
|
|
## export_to_gif
|
|
|
|
[[autodoc]] utils.export_to_gif
|
|
|
|
## export_to_video
|
|
|
|
[[autodoc]] utils.export_to_video
|
|
|
|
## make_image_grid
|
|
|
|
[[autodoc]] utils.make_image_grid
|
|
|
|
## randn_tensor
|
|
|
|
[[autodoc]] utils.torch_utils.randn_tensor
|
|
|
|
## apply_layerwise_casting
|
|
|
|
[[autodoc]] hooks.layerwise_casting.apply_layerwise_casting
|
|
|
|
## apply_group_offloading
|
|
|
|
[[autodoc]] hooks.group_offloading.apply_group_offloading
|