AI/diffusers
1
0
Fork 0
mirror of https://github.com/huggingface/diffusers.git synced 2026-01-27 17:22:53 +03:00
Code Activity
6,192 Commits 740 Branches 94 Tags
model-test-refactor
Commit Graph

66 Commits

Author SHA1 Message Date
Salman Chishti
a812c87465 Upgrade GitHub Actions for Node 24 compatibility (#12865) 
Signed-off-by: Salman Muin Kayser Chishti <13schishti@gmail.com>
 2026-01-09 08:28:58 +05:30
Dhruv Nair
b7df4a5387 [CI] Temporarily pin transformers (#12677) 
* update

* update

* update

* update
 2025-11-18 14:43:06 +05:30
Dhruv Nair
3579fdabf9 [CI] Make CI logs less verbose (#12674) 
update
 2025-11-17 14:23:09 +05:30
vb
57636ad4f4 purge HF_HUB_ENABLE_HF_TRANSFER; promote Xet (#12497) 
* purge HF_HUB_ENABLE_HF_TRANSFER; promote Xet

* purge HF_HUB_ENABLE_HF_TRANSFER; promote Xet x2

* restrict docker build test to the ones we actually use in CI.

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2025-10-22 00:59:20 +05:30
Sayak Paul
a519272d97 [ci] revisit the installations in CI. (#12450) 
* revisit the installations in CI.

* up

* up

* up

* empty

* up

* up

* up
 2025-10-08 19:21:24 +05:30
Sayak Paul
35e538d46a fix dockerfile definitions. (#12424) 
* fix dockerfile definitions.

* python 3.10 slim.

* up

* up

* up

* up

* up

* revert pr_tests.yml changes

* up

* up

* reduce python version for torch 2.1.0
 2025-10-08 09:46:18 +05:30
Lucain
b59654544b Install latest prerelease from huggingface_hub when installing transformers from main (#12395) 
* Allow prerelease when installing transformers from main

* maybe better

* maybe better

* and now?

* just bored

* should be better

* works now
 2025-09-30 17:02:33 +05:30
Sayak Paul
4588bbeb42 [CI] disable installing transformers from main in ci for now. (#12397) 
* disable installing transformers from main in ci for now.

* up

* u[p
 2025-09-26 18:41:17 +05:30
Sayak Paul
e8e44a510c [CI] disable onnx, mps, flax from the CI (#11803) 
* disable onnx, mps, flax

* remove
 2025-06-27 16:33:43 +05:30
Sayak Paul
54cddc1e12 [CI] fix the filename for displaying failures in lora ci. (#11600) 
fix the filename for displaying failures in lora ci.
 2025-05-27 22:27:27 -07:00
Sayak Paul
d88ae1f52a update dep table. (#11504) 
* update dep table.

* fix
 2025-05-06 11:14:07 +05:30
Sayak Paul
1be0202502 [CI] remove synchornized. (#10980) 
removed synchornized.
 2025-03-06 17:03:19 +05:30
Sayak Paul
1f853504da [CI] install accelerate transformers from main (#10289) 
install accelerate transformers from .
 2025-02-20 23:06:40 +05:30
Sayak Paul
f550745a2b [Utils] add utilities for checking if certain utilities are properly documented (#7763) 
* add; utility to check if attn_procs,norms,acts are properly documented.

* add support listing to the workflows.

* change to 2024.

* small fixes.

* does adding detailed docstrings help?

* uncomment image processor check

* quality

* fix, thanks to @mishig.

* Apply suggestions from code review

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* style

* JointAttnProcessor2_0

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* Update docs/source/en/api/normalization.md

Co-authored-by: hlky <hlky@hlky.ac>

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
Co-authored-by: hlky <hlky@hlky.ac>
 2025-02-20 12:37:00 +05:30
Sayak Paul
680a8ed855 [misc] feat: introduce a style bot. (#10274) 
* feat: introduce a style bot.

* updates

* Apply suggestions from code review

Co-authored-by: Guillaume LEGENDRE <glegendre01@gmail.com>

* apply suggestion

* fixes

* updates

---------

Co-authored-by: Guillaume LEGENDRE <glegendre01@gmail.com>
 2025-02-19 20:49:10 +05:30
hlky
4df9d49218 Fix tokenizers install from main in LoRA tests (#10494) 
* Fix tokenizers install from main in LoRA tests

* @

* rust

* -e

* uv

* just update tokenizers
 2025-01-08 16:14:25 +00:00
hlky
1288c8560a Update tokenizers in pr_test_peft_backend (#10132) 
Update tokenizers
 2025-01-08 10:09:32 +00:00
Sayak Paul
25f3e91c81 [CI] merge peft pr workflow into the main pr workflow. (#10042) 
* merge peft pr workflow into the main pr workflow.

* remove latest

---------

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-12-12 13:13:09 +05:30
Sayak Paul
c7a6d77b5f [CI] replace ubuntu version to 22.04. (#9656) 
replace ubuntu version to 22.04.
 2024-10-12 11:55:36 +05:30
Sayak Paul
28f9d84549 [CI] allow faster downloads from the Hub in CI. (#9478) 
* allow faster downloads from the Hub in CI.

* HF_HUB_ENABLE_HF_TRANSFER: 1

* empty

* empty

* remove ENV HF_HUB_ENABLE_HF_TRANSFER=1.

* empty
 2024-09-24 09:42:11 +05:30
Sayak Paul
5440cbd34e [CI] updates to the CI report naming, and accelerate installation (#9429) 
* chore: id accordingly to avoid duplicates.

* update properly.

* updates

* updates

* empty

* updates

* changing order helps?
 2024-09-16 11:29:07 -10:00
Sayak Paul
6cf8d98ce1 [CI] update artifact uploader version (#9426) 
update artifact uploader version
 2024-09-12 19:26:09 +05:30
Adrien
bfc9369f0a [CI] Update runner configuration for setup and nightly tests (#9005) 
* [CI] Update runner configuration for setup and nightly tests

Signed-off-by: Adrien <adrien@huggingface.co>

* fix group

Signed-off-by: Adrien <adrien@huggingface.co>

* update for t4

Signed-off-by: Adrien <adrien@huggingface.co>

---------

Signed-off-by: Adrien <adrien@huggingface.co>
 2024-07-29 21:14:31 +05:30
Isamu Isozaki
d27e996ccd Adding VQGAN Training script (#5483) 
* Init commit

* Removed einops

* Added default movq config for training

* Update explanation of prompts

* Fixed inheritance of discriminator and init_tracker

* Fixed incompatible api between muse and here

* Fixed output

* Setup init training

* Basic structure done

* Removed attention for quick tests

* Style fixes

* Fixed vae/vqgan styles

* Removed redefinition of wandb

* Fixed log_validation and tqdm

* Nothing commit

* Added commit loss to lookup_from_codebook

* Update src/diffusers/models/vq_model.py

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Adding perliminary README

* Fixed one typo

* Local changes

* Fixed main issues

* Merging

* Update src/diffusers/models/vq_model.py

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Testing+Fixed bugs in training script

* Some style fixes

* Added wandb to docs

* Fixed timm test

* get testing suite ready.

* remove return loss

* remove return_loss

* Remove diffs

* Remove diffs

* fix ruff format

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-05-15 08:47:12 +05:30
Sayak Paul
30c977d1f5 [Workflows] remove installation of redundant modules from flax PR tests (#7662) 
remove installation of redundant modules from flax PR tests
 2024-04-17 15:16:04 +05:30
Sayak Paul
c827e94da0 [Workflows] remove installation of libsndfile1-dev and libgl1 from workflows (#7543) 
* remove libsndfile1-dev and libgl1 from workflows and ensure that re present in the respective dockerfiles.

* change to self-hosted runner; let's see 🤞

* add libsndfile1-dev libgl1 for now

* use self-hosted runners for building and push too.
 2024-04-10 08:34:56 +05:30
Sayak Paul
ad55ce6100 [Chore] increase number of workers for the tests. (#7558) 
* increase number of workers for the tests.

* move to beefier runner.

* improve the fast push tests too.

* use a beefy machine for pytorch pipeline tests

* up the number of workers further.
 2024-04-03 17:11:42 +05:30
Sayak Paul
4a34307702 add: utility to format our docs too 📜 (#7314) 
* add: utility to format our docs too 📜

* debugging saga

* fix: message

* checking

* should be fixed.

* revert pipeline_fixture

* remove empty line

* make style

* fix: setup.py

* style.
 2024-04-02 20:49:43 +05:30
Sayak Paul
6df103deba add: a helpful message when quality and repo consistency checks fail. (#7475) 2024-03-28 13:51:56 +05:30
Sayak Paul
3daebe2b44 use uv for installing stuff in the workflows. (#7116) 
* use uv for installing stuff in the workflows.

* fix: from source installation command when using uv.

* fix uv venv issue

* edit editable installation.

* fix quality installation

* checking

* make editable.

* more check

* check

* add: export step

* venv handling.

* checking.

* fix: dependency workflows.

* peft tests.

* proper way to initialize env.

* Empty-Commit

* Empty-Commit
 2024-02-29 08:27:24 +05:30
Sayak Paul
fa9bc029b4 [Tests] make test steps dependent on certain things and general cleanup of the workflows (#7026) 
make tests conditional and other things.
 2024-02-28 08:26:46 +05:30
Sayak Paul
ca9ed5e8d1 [LoRA] deprecate certain lora methods from the old backend. (#6889) 
* deprecate certain lora methods from the old backend.

* uncomment necessary things.

* safe remove old lora backend 👋
 2024-02-09 17:14:32 +01:00
Younes Belkada
c2717317f0 [PEFT] Adapt example scripts to use PEFT (#5388) 
* adapt example scripts to use PEFT

* Update examples/text_to_image/train_text_to_image_lora.py

* fix

* add for SDXL

* oops

* make sure to install peft

* fix

* fix

* fix dreambooth and lora

* more fixes

* add peft to requirements.txt

* fix

* final fix

* add peft version in requirements

* remove comment

* change variable names

* add few lines in readme

* add to reqs

* style

* fix issues

* fix lora dreambooth xl tests

* init_lora_weights to gaussian and add out proj where missing

* ammend requirements.

* ammend requirements.txt

* add correct peft versions

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2023-12-07 09:39:29 +05:30
Sayak Paul
fdd003d8e2 [Tests] Refactor test_examples.py for better readability (#5946) 
* control and custom diffusion

* dreambooth

* instructpix2pix and dreambooth ckpting

* t2i adapters.

* text to image ft

* textual inversion

* unconditional

* workflows

* import fix

* fix import
 2023-11-29 18:43:59 +05:30
Dhruv Nair
43346adc1f Install accelerate from PyPI in PR test runner (#5721) 
install acclerate from pypi
 2023-11-09 15:38:00 +05:30
Patrick von Platen
119ad2c3dc [LoRA] Centralize LoRA tests (#5086) 
* [LoRA] Centralize LoRA tests

* [LoRA] Centralize LoRA tests

* [LoRA] Centralize LoRA tests

* [LoRA] Centralize LoRA tests

* [LoRA] Centralize LoRA tests
 2023-09-18 17:54:33 +02:00
Will Berman
4191ddee11 Revert revert and install accelerate main (#4963) 
* Revert "Temp Revert "[Core] better support offloading when side loading is enabled… (#4927)"

This reverts commit 2ab170499e.

* tests: install accelerate from main
 2023-09-11 08:49:46 +02:00
Sayak Paul
15782fd506 [Pipeline utils] feat: implement push_to_hub for standalone models, schedulers as well as pipelines (#4128) 
* feat: implement push_to_hub for standalone models.

* address PR feedback.

* Apply suggestions from code review

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* remove max_shard_size.

* add: support for scheduler push_to_hub

* enable push_to_hub support for flax schedulers.

* enable push_to_hub for pipelines.

* Apply suggestions from code review

Co-authored-by: Lucain <lucainp@gmail.com>

* reflect pr feedback.

* address another round of deedback.

* better handling of kwargs.

* add: tests

* Apply suggestions from code review

Co-authored-by: Lucain <lucainp@gmail.com>

* setting hub staging to False for now.

* incorporate staging test as a separate job.

Co-authored-by: ydshieh <2521628+ydshieh@users.noreply.github.com>

* fix: tokenizer loading.

* fix: json dumping.

* move is_staging_test to a better location.

* better treatment to tokens.

* define repo_id to better handle concurrency

* style

* explicitly set token

* Empty-Commit

* move SUER, TOKEN to test

* collate org_repo_id

* delete repo

---------

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Lucain <lucainp@gmail.com>
Co-authored-by: ydshieh <2521628+ydshieh@users.noreply.github.com>
 2023-08-15 07:39:22 +05:30
Lucain
d7280b7436 Trigger CI on ci-* branches (#3635) 2023-07-12 19:31:36 +02:00
Patrick von Platen
bc9a8cef6f [SD-XL] Add new pipelines (#3859) 
* Add new text encoder

* add transformers depth

* More

* Correct conversion script

* Fix more

* Fix more

* Correct more

* correct text encoder

* Finish all

* proof that in works in run local xl

* clean up

* Get refiner to work

* Add red castle

* Fix batch size

* Improve pipelines more

* Finish text2image tests

* Add img2img test

* Fix more

* fix import

* Fix embeddings for classic models (#3888)

Fix embeddings for classic SD models.

* Allow multiple prompts to be passed to the refiner (#3895)

* finish more

* Apply suggestions from code review

* add watermarker

* Model offload (#3889)

* Model offload.

* Model offload for refiner / img2img

* Hardcode encoder offload on img2img vae encode

Saves some GPU RAM in img2img / refiner tasks so it remains below 8 GB.

---------

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* correct

* fix

* clean print

* Update install warning for `invisible-watermark`

* add: missing docstrings.

* fix and simplify the usage example in img2img.

* fix setup for watermarking.

* Revert "fix setup for watermarking."

This reverts commit 491bc9f5a6.

* fix: watermarking setup.

* fix: op.

* run make fix-copies.

* make sure tests pass

* improve convert

* make tests pass

* make tests pass

* better error message

* fiinsh

* finish

* Fix final test

---------

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2023-07-06 13:37:27 +02:00
Sayak Paul
49949f321d [Tests] add test for checking soft dependencies. (#3847) 
* add test for checking soft dependencies.

* address patrick's comments.

* dependency tests should not run twice.

* debugging.

* up.
 2023-06-28 22:05:25 +05:30
Pedro Cuenca
f7b4f51cc2 mps & onnx tests rework (#3449) 
* Remove ONNX tests from PR.

They are already a part of push_tests.yml.

* Remove mps tests from PRs.

They are already performed on push.

* Fix workflow name for fast push tests.

* Extract mps tests to a workflow.

For better control/filtering.

* Remove --extra-index-url from mps tests

* Increase tolerance of mps test

This test passes in my Mac (Ventura 13.3) but fails in the CI hardware
(Ventura 13.2). I ran the local tests following the same steps that
exist in the CI workflow.

* Temporarily run mps tests on pr

So we can test.

* Revert "Temporarily run mps tests on pr"

Tests passed, go back to running on push.
 2023-05-20 13:43:07 +02:00
Patrick von Platen
28f404349d Improve fast tests (#3416) 
Update pr_tests.yml
 2023-05-12 14:01:03 +01:00
Patrick von Platen
3a9d7d9758 [Tests] parallelize (#3078) 
* [Tests] parallelize

* finish folder structuring

* Parallelize tests more

* Correct saving of pipelines

* make sure logging level is correct

* try again

* Apply suggestions from code review

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

---------

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
 2023-04-13 13:32:57 +01:00
Patrick von Platen
8369196703 fix report tool (#3047) 2023-04-11 10:55:00 +02:00
Anton Lozhkov
4f0141a67d Fix ONNX checkpoint loading (#2544) 
* Revert "Disable ONNX tests (#2509)"

This reverts commit a0549fea44.

* add external weights

* + pb

* style
 2023-03-03 16:08:56 +01:00
Patrick von Platen
a0549fea44 Disable ONNX tests (#2509) 2023-02-27 18:58:15 +01:00
Patrick von Platen
1ed6b77781 [Examples] Test all examples on CPU (#2289) 
* [Examples] Test all examples on CPU

* add

* correct

* Apply suggestions from code review
 2023-02-08 15:59:13 +01:00
Patrick von Platen
f2e521c499 [Dtype] Align dtype casting behavior with Transformers and Accelerate (#1725) 
* [Dtype] Align automatic dtype

* up

* up

* fix

* re-add accelerate
 2022-12-29 14:36:02 +01:00
Suraj Patil
d07f73003d Fix num images per prompt unclip (#1787) 
* use repeat_interleave

* fix repeat

* Trigger Build

* don't install accelerate from main

* install released accelrate for mps test

* Remove additional accelerate installation from main.

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
 2022-12-20 16:03:38 +01:00