mirror of
https://github.com/huggingface/diffusers.git
synced 2026-01-27 17:22:53 +03:00
Update distributed_inference.md to correct syntax (#12827)
This commit is contained in:
@@ -297,9 +297,9 @@ if __name__ == "__main__":
|
||||
|
||||
The script above needs to be run with a distributed launcher, such as [torchrun](https://docs.pytorch.org/docs/stable/elastic/run.html), that is compatible with PyTorch. `--nproc-per-node` is set to the number of GPUs available.
|
||||
|
||||
/```shell
|
||||
`torchrun --nproc-per-node 2 above_script.py`.
|
||||
/```
|
||||
```shell
|
||||
torchrun --nproc-per-node 2 above_script.py
|
||||
```
|
||||
|
||||
### Ulysses Attention
|
||||
|
||||
@@ -332,4 +332,4 @@ transformer = AutoModel.from_pretrained(
|
||||
pipeline = DiffusionPipeline.from_pretrained(
|
||||
CKPT_ID, transformer=transformer, torch_dtype=torch.bfloat16,
|
||||
).to(device)
|
||||
```
|
||||
```
|
||||
|
||||
Reference in New Issue
Block a user