mirror of
https://github.com/huggingface/diffusers.git
synced 2026-10-24 20:59:27 +03:00
351de3a6fe
* docs
* update
* Revert "docs"
This reverts commit 04ca80543f.
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2.0 KiB
2.0 KiB
Intel Gaudi
The Intel Gaudi AI accelerator family includes Intel Gaudi 1, Intel Gaudi 2, and Intel Gaudi 3. Each server is equipped with 8 devices, known as Habana Processing Units (HPUs), providing 128GB of memory on Gaudi 3, 96GB on Gaudi 2, and 32GB on the first-gen Gaudi. For more details on the underlying hardware architecture, check out the Gaudi Architecture overview.
Diffusers pipelines can take advantage of HPU acceleration, even if a pipeline hasn't been added to Optimum for Intel Gaudi yet, with the GPU Migration Toolkit.
Call .to("hpu") on your pipeline to move it to a HPU device as shown below for Flux:
import torch
from diffusers import DiffusionPipeline
pipeline = DiffusionPipeline.from_pretrained("black-forest-labs/FLUX.1-schnell", dtype=torch.bfloat16)
pipeline.to("hpu")
image = pipeline("An image of a squirrel in Picasso style").images[0]
Tip
For Gaudi-optimized diffusion pipeline implementations, we recommend using Optimum for Intel Gaudi.