From 5455dd58e8a174214ab32f5cc6fd24bd51d87bec Mon Sep 17 00:00:00 2001 From: Sayak Paul Date: Fri, 12 Dec 2025 00:46:43 +0800 Subject: [PATCH] Update distributed_inference.md to correct syntax (#12827) --- docs/source/en/training/distributed_inference.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/docs/source/en/training/distributed_inference.md b/docs/source/en/training/distributed_inference.md index 534124cb93..22e8a30427 100644 --- a/docs/source/en/training/distributed_inference.md +++ b/docs/source/en/training/distributed_inference.md @@ -297,9 +297,9 @@ if __name__ == "__main__": The script above needs to be run with a distributed launcher, such as [torchrun](https://docs.pytorch.org/docs/stable/elastic/run.html), that is compatible with PyTorch. `--nproc-per-node` is set to the number of GPUs available. -/```shell -`torchrun --nproc-per-node 2 above_script.py`. -/``` +```shell +torchrun --nproc-per-node 2 above_script.py +``` ### Ulysses Attention @@ -332,4 +332,4 @@ transformer = AutoModel.from_pretrained( pipeline = DiffusionPipeline.from_pretrained( CKPT_ID, transformer=transformer, torch_dtype=torch.bfloat16, ).to(device) -``` \ No newline at end of file +```