mirror of
https://github.com/huggingface/diffusers.git
synced 2026-01-29 07:22:12 +03:00
7b904941bc
* begin transformer conversion * refactor * refactor * refactor * refactor * refactor * refactor * update * add conversion script * add pipeline * make fix-copies * remove einops * update docs * gradient checkpointing * add transformer test * update * debug * remove prints * match sigmas * add vae pt. 1 * finish CV* vae * update * update * update * update * update * update * make fix-copies * update * make fix-copies * fix * update * update * make fix-copies * update * update tests * handle device and dtype for safety checker; required in latest diffusers * remove enable_gqa and use repeat_interleave instead * enforce safety checker; use dummy checker in fast tests * add review suggestion for ONNX export Co-Authored-By: Asfiya Baig <asfiyab@nvidia.com> * fix safety_checker issues when not passed explicitly We could either do what's done in this commit, or update the Cosmos examples to explicitly pass the safety checker * use cosmos guardrail package * auto format docs * update conversion script to support 14B models * update name CosmosPipeline -> CosmosTextToWorldPipeline * update docs * fix docs * fix group offload test failing for vae --------- Co-authored-by: Asfiya Baig <asfiyab@nvidia.com>
41 lines
1.2 KiB
Markdown
41 lines
1.2 KiB
Markdown
<!-- Copyright 2024 The HuggingFace Team. All rights reserved.
|
|
|
|
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
|
|
the License. You may obtain a copy of the License at
|
|
|
|
http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
|
|
an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
|
|
specific language governing permissions and limitations under the License. -->
|
|
|
|
# AutoencoderKLCosmos
|
|
|
|
[Cosmos Tokenizers](https://github.com/NVIDIA/Cosmos-Tokenizer).
|
|
|
|
Supported models:
|
|
- [nvidia/Cosmos-1.0-Tokenizer-CV8x8x8](https://huggingface.co/nvidia/Cosmos-1.0-Tokenizer-CV8x8x8)
|
|
|
|
The model can be loaded with the following code snippet.
|
|
|
|
```python
|
|
from diffusers import AutoencoderKLCosmos
|
|
|
|
vae = AutoencoderKLCosmos.from_pretrained("nvidia/Cosmos-1.0-Tokenizer-CV8x8x8", subfolder="vae")
|
|
```
|
|
|
|
## AutoencoderKLCosmos
|
|
|
|
[[autodoc]] AutoencoderKLCosmos
|
|
- decode
|
|
- encode
|
|
- all
|
|
|
|
## AutoencoderKLOutput
|
|
|
|
[[autodoc]] models.autoencoders.autoencoder_kl.AutoencoderKLOutput
|
|
|
|
## DecoderOutput
|
|
|
|
[[autodoc]] models.autoencoders.vae.DecoderOutput
|