diff --git a/docs/source/en/training/distributed_inference.md b/docs/source/en/training/distributed_inference.md index 534124cb93..22e8a30427 100644 --- a/docs/source/en/training/distributed_inference.md +++ b/docs/source/en/training/distributed_inference.md @@ -297,9 +297,9 @@ if __name__ == "__main__": The script above needs to be run with a distributed launcher, such as [torchrun](https://docs.pytorch.org/docs/stable/elastic/run.html), that is compatible with PyTorch. `--nproc-per-node` is set to the number of GPUs available. -/```shell -`torchrun --nproc-per-node 2 above_script.py`. -/``` +```shell +torchrun --nproc-per-node 2 above_script.py +``` ### Ulysses Attention @@ -332,4 +332,4 @@ transformer = AutoModel.from_pretrained( pipeline = DiffusionPipeline.from_pretrained( CKPT_ID, transformer=transformer, torch_dtype=torch.bfloat16, ).to(device) -``` \ No newline at end of file +```