Sayak Paul
25caf24ef9
Fix release workflow deps ( #7339 )
...
* pop scale from the top-level unet instead of getting it.
* improve readability.
* fix: pypi workflow deps
* revert
2024-03-16 07:18:11 +05:30
Sayak Paul
e0e9f81971
add: torch to the pypi step. ( #7328 )
2024-03-15 12:28:12 +05:30
Sayak Paul
95de1981c9
add: pytest log installation ( #7313 )
2024-03-14 10:01:16 +05:30
Sayak Paul
46ab56a468
add: support for notifying maintainers about the nightly test status ( #7117 )
...
* add: support for notifying maintainers about the nightly test status
* add: a tempoerary workflow for validation.
* cancel in progress.
* runs-on
* clean up
* add: peft dep
* change device.
* multiple edits.
* remove temp workflow.
2024-03-13 16:48:11 +05:30
Sayak Paul
038ff70023
[PyPI publishing] feat: automate the process of pypi publication to some extent. ( #7270 )
...
* feat: automate the process of pypi publication to some extent.
* utility to fetch the latest release branch
* correct package name.
2024-03-13 16:27:59 +05:30
Sayak Paul
5dd8e04d4b
[Dockerfiles] add: a workflow to check if docker containers can be built in case of modifications ( #7129 )
...
* add: a workflow to check if docker containers can be built if the files are modified.
* type
* unify docker image build test and push
* make it run on prs too.
* check
* check
* check
* check again.
* remove docker test build file.
* remove extra dependencies./
* check
2024-03-11 08:54:00 +05:30
Dhruv Nair
64a8cd627a
[CI] Remove max parallel flag on slow test runners ( #7162 )
...
update
2024-03-01 11:38:21 +05:30
Sayak Paul
5d3923b670
Fix LCM benchmark test ( #7158 )
...
* make workflow dispatchable.
* fix: lcm lora compile
2024-03-01 10:33:44 +05:30
Sayak Paul
9451235e5a
[Urgent][Docker CI] pin uv version for now and a minor change in the Slack notification ( #7155 )
...
pin uv version for now.
2024-03-01 10:11:07 +05:30
Sayak Paul
c2b6ac4e34
[CI] fix path filtering in the documentation workflows ( #7153 )
...
fix: path
2024-03-01 07:18:49 +05:30
Sayak Paul
fcfa270fbd
add: support for notifying the maintainers about the docker ci status. ( #7113 )
2024-02-29 19:28:52 +05:30
Sayak Paul
56dac1cedc
limit documentation workflow runs for relevant changes. ( #7125 )
2024-02-29 19:01:54 +05:30
Sayak Paul
3daebe2b44
use uv for installing stuff in the workflows. ( #7116 )
...
* use uv for installing stuff in the workflows.
* fix: from source installation command when using uv.
* fix uv venv issue
* edit editable installation.
* fix quality installation
* checking
* make editable.
* more check
* check
* add: export step
* venv handling.
* checking.
* fix: dependency workflows.
* peft tests.
* proper way to initialize env.
* Empty-Commit
* Empty-Commit
2024-02-29 08:27:24 +05:30
Dhruv Nair
e6cf21906d
[Diffusers CI] Switch slow test runners ( #7123 )
...
update
2024-02-28 22:15:04 +05:30
Sayak Paul
fa9bc029b4
[Tests] make test steps dependent on certain things and general cleanup of the workflows ( #7026 )
...
make tests conditional and other things.
2024-02-28 08:26:46 +05:30
Sayak Paul
087daee2f0
add: peft to the benchmark workflow ( #6989 )
2024-02-16 09:29:10 +05:30
Sayak Paul
ca9ed5e8d1
[LoRA] deprecate certain lora methods from the old backend. ( #6889 )
...
* deprecate certain lora methods from the old backend.
* uncomment necessary things.
* safe remove old lora backend 👋
2024-02-09 17:14:32 +01:00
Patrick von Platen
9e2804f720
Update pr_test_peft_backend.yml to use 1 process for testing ( #6613 )
2024-01-17 19:25:30 +05:30
Sayak Paul
63de23e3db
disable running peft non-peft lora test in the peft env. ( #6437 )
...
* disable running peft non-peft lora test in the peft env.
* Empty-Commit
2024-01-04 10:18:46 +05:30
Sayak Paul
2db73f4a50
remove delete documentation trigger workflows. ( #6373 )
2023-12-28 18:26:14 +05:30
Sayak Paul
bf40d7d82a
add peft dependency to fast push tests ( #6229 )
...
* add peft dependency
* add peft dependency at the correct place.
2023-12-19 13:26:25 +05:30
Sayak Paul
1d686bac81
[feat: Benchmarking Workflow] add stuff for a benchmarking workflow ( #5839 )
...
* add poc for benchmarking workflow.
* import
* fix argument
* fix: argument
* fix: path
* fix
* fix
* path
* output csv files.
* workflow cleanup
* append token
* add utility to push to hf dataset
* fix: kw arg
* better reporting
* fix: headers
* better formatting of the numbers.
* better type annotation
* fix: formatting
* moentarily disable check
* push results.
* remove disable check
* introduce base classes.
* img2img class
* add inpainting pipeline
* intoduce base benchmark class.
* add img2img and inpainting
* feat: utility to compare changes
* fix
* fix import
* add args
* basepath
* better exception handling
* better path handling
* fix
* fix
* remove
* ifx
* fix
* add: support for controlnet.
* image_url -> url
* move images to huggingface hub
* correct urls.
* root_ckpt
* flush before benchmarking
* don't install accelerate from source
* add runner
* simplify Diffusers Benchmarking step
* change runner
* fix: subprocess call.
* filter percentage values
* fix controlnet benchmark
* add t2i adapters.
* fix filter columns
* fix t2i adapter benchmark
* fix init.
* fix
* remove safetensors flag
* fix args print
* fix
* feat: run_command
* add adapter resolution mapping
* benchmark t2i adapter fix.
* fix adapter input
* fix
* convert to L.
* add flush() add appropriate places
* better filtering
* okay
* get env for torch
* convert to float
* fix
* filter out nans.
* better coment
* sdxl
* sdxl for other benchmarks.
* fix: condition
* fix: condition for inpainting
* fix: mapping for resolution
* fix
* include kandinsky and wuerstchen
* fix: Wuerstchen
* Empty-Commit
* [Community] AnimateDiff + Controlnet Pipeline (#5928 )
* begin work on animatediff + controlnet pipeline
* complete todos, uncomment multicontrolnet, input checks
Co-Authored-By: EdoardoBotta <botta.edoardo@gmail.com >
* update
Co-Authored-By: EdoardoBotta <botta.edoardo@gmail.com >
* add example
* update community README
* Update examples/community/README.md
---------
Co-authored-by: EdoardoBotta <botta.edoardo@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* EulerDiscreteScheduler add `rescale_betas_zero_snr` (#6024 )
* EulerDiscreteScheduler add `rescale_betas_zero_snr`
* Revert "[Community] AnimateDiff + Controlnet Pipeline (#5928 )"
This reverts commit 821726d7c0#6024 )"
This reverts commit 3dc2362b5apatrick.v.platen@gmail.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
Co-authored-by: Aryan V S <contact.aryanvs@gmail.com >
Co-authored-by: EdoardoBotta <botta.edoardo@gmail.com >
Co-authored-by: Beinsezii <39478211+Beinsezii@users.noreply.github.com >
2023-12-12 11:03:34 +05:30
Younes Belkada
c2717317f0
[PEFT] Adapt example scripts to use PEFT ( #5388 )
...
* adapt example scripts to use PEFT
* Update examples/text_to_image/train_text_to_image_lora.py
* fix
* add for SDXL
* oops
* make sure to install peft
* fix
* fix
* fix dreambooth and lora
* more fixes
* add peft to requirements.txt
* fix
* final fix
* add peft version in requirements
* remove comment
* change variable names
* add few lines in readme
* add to reqs
* style
* fix issues
* fix lora dreambooth xl tests
* init_lora_weights to gaussian and add out proj where missing
* ammend requirements.
* ammend requirements.txt
* add correct peft versions
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-07 09:39:29 +05:30
Dhruv Nair
20ba1fdbbd
Disable Tests Fetcher ( #6060 )
...
update
2023-12-06 18:10:11 +05:30
Dhruv Nair
b21729225a
Update Tests Fetcher ( #5950 )
...
* update setup and deps table
* update
* update
* update
* up
* up
* update
* up
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* quality fix
* fix failure reporting
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-12-04 12:59:41 +05:30
Sayak Paul
fdd003d8e2
[Tests] Refactor test_examples.py for better readability ( #5946 )
...
* control and custom diffusion
* dreambooth
* instructpix2pix and dreambooth ckpting
* t2i adapters.
* text to image ft
* textual inversion
* unconditional
* workflows
* import fix
* fix import
2023-11-29 18:43:59 +05:30
Patrick von Platen
ebf581e85f
[Tests] Make sure that we don't run tests multiple times ( #5949 )
...
* [Tests] Make sure that we don't run tests mulitple times
* [Tests] Make sure that we don't run tests mulitple times
* [Tests] Make sure that we don't run tests mulitple times
2023-11-27 14:18:56 +01:00
Dhruv Nair
ebc7bedeb7
Add tests fetcher ( #5848 )
...
* add tests fetcher to utils
* add test fetcher
* update
* update
* remove unused dependency version check script
* update
* fix mistake
* update
* update
* update
* update
* update
* update
* update
* remove concurrency params
* update
* update
* update
* update
* update
* update
* move test fetcher to dedicated workflow
2023-11-21 18:01:44 +05:30
Younes Belkada
fda297703f
[test / peft] Fix silent behaviour on PR tests ( #5852 )
...
Update pr_test_peft_backend.yml
2023-11-20 12:42:58 +01:00
Kashif Rasul
6b04d61cf6
[Styling] stylify using ruff ( #5841 )
...
* ruff format
* not need to use doc-builder's black styling as the doc is styled in ruff
* make fix-copies
* comment
* use run_ruff
2023-11-20 11:48:34 +01:00
Younes Belkada
4e54dfe985
[Tests/LoRA/PEFT] Test also on PEFT / transformers / accelerate latest ( #5820 )
...
* add also peft latest on peft CI
* up
* up
* up
* Update .github/workflows/pr_test_peft_backend.yml
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-11-17 19:17:31 +01:00
Dhruv Nair
43346adc1f
Install accelerate from PyPI in PR test runner ( #5721 )
...
install acclerate from pypi
2023-11-09 15:38:00 +05:30
Dhruv Nair
97c8199dbb
Explicit torch/flax dependency check ( #5673 )
...
* explicit torch dependency check
* update
* update
* update
2023-11-07 16:38:20 +01:00
Younes Belkada
8f3100db9f
[PEFT / Tests] Add peft slow tests on push ( #5419 )
...
* add peft slow tests workflow
* Update .github/workflows/push_tests.yml
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-10-30 14:27:00 +01:00
Gabriel de Souza
9135e54e76
docs: initial pt translation ( #5549 )
...
* docs: initial pt translation
* docs: add pt build to github workflow and fix some missing translations
2023-10-27 10:51:35 -07:00
Isamu Isozaki
b8896a154a
Japanese docs ( #5478 )
...
* Finished _toctree.yml and index.md
* Finished installation.md
* Properly finished installation.md and almost finished quicktour
* Finished quicktour
* Finished stable diffusion doc
* Fixed _toctree.yml
* Fixed requests
* Fix country code
* Properly push
2023-10-24 11:30:04 -07:00
Dhruv Nair
4d2c981d55
New xformers test runner ( #5349 )
...
* move xformers to dedicated runner
* fix
* remove ptl from test runner images
2023-10-13 00:32:39 +05:30
Dhruv Nair
dd5a36291f
New Pipeline Slow Test runners ( #5131 )
...
* pipline fetcher
* update script
* clean up
* clean up
* clean up
* new pipeline runner
* rename tests to match modules
* test actions in pr
* change runner to gpu
* clean up
* clean up
* clean up
* fix report
* fix reporting
* clean up
* show test stats in failure reports
* give names to jobs
* add lora tests
* split torch cuda tests and add compile tests
* clean up
* fix tests
* change push to run only on main
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-10-04 11:42:17 +02:00
Dhruv Nair
bdd2544673
Tests compile fixes ( #5148 )
...
* test fix
* fix tests
* fix report name
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-09-26 11:36:46 +05:30
Younes Belkada
493f9529d7
[PEFT / LoRA] PEFT integration - text encoder ( #5058 )
...
* more fixes
* up
* up
* style
* add in setup
* oops
* more changes
* v1 rzfactor CI
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* few todos
* protect torch import
* style
* fix fuse text encoder
* Update src/diffusers/loaders.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* replace with `recurse_replace_peft_layers`
* keep old modules for BC
* adjustments on `adjust_lora_scale_text_encoder`
* nit
* move tests
* add conversion utils
* remove unneeded methods
* use class method instead
* oops
* use `base_version`
* fix examples
* fix CI
* fix weird error with python 3.8
* fix
* better fix
* style
* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* add comment
* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* conv2d support for recurse remove
* added docstrings
* more docstring
* add deprecate
* revert
* try to fix merge conflicts
* v1 tests
* add new decorator
* add saving utilities test
* adapt tests a bit
* add save / from_pretrained tests
* add saving tests
* add scale tests
* fix deps tests
* fix lora CI
* fix tests
* add comment
* fix
* style
* add slow tests
* slow tests pass
* style
* Update src/diffusers/utils/import_utils.py
Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com >
* Apply suggestions from code review
Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com >
* circumvents pattern finding issue
* left a todo
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* update hub path
* add lora workflow
* fix
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com >
2023-09-22 13:03:39 +02:00
Younes Belkada
914586f5b6
[core] Use python 3.8 in workflow and setup file ( #5122 )
...
* use python 3.7 instead
* Update setup.py
2023-09-20 20:57:06 +02:00
Patrick von Platen
119ad2c3dc
[LoRA] Centralize LoRA tests ( #5086 )
...
* [LoRA] Centralize LoRA tests
* [LoRA] Centralize LoRA tests
* [LoRA] Centralize LoRA tests
* [LoRA] Centralize LoRA tests
* [LoRA] Centralize LoRA tests
2023-09-18 17:54:33 +02:00
Will Berman
4191ddee11
Revert revert and install accelerate main ( #4963 )
...
* Revert "Temp Revert "[Core] better support offloading when side loading is enabled… (#4927 )"
This reverts commit 2ab170499e
2023-09-11 08:49:46 +02:00
Sayak Paul
15782fd506
[Pipeline utils] feat: implement push_to_hub for standalone models, schedulers as well as pipelines ( #4128 )
...
* feat: implement push_to_hub for standalone models.
* address PR feedback.
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* remove max_shard_size.
* add: support for scheduler push_to_hub
* enable push_to_hub support for flax schedulers.
* enable push_to_hub for pipelines.
* Apply suggestions from code review
Co-authored-by: Lucain <lucainp@gmail.com >
* reflect pr feedback.
* address another round of deedback.
* better handling of kwargs.
* add: tests
* Apply suggestions from code review
Co-authored-by: Lucain <lucainp@gmail.com >
* setting hub staging to False for now.
* incorporate staging test as a separate job.
Co-authored-by: ydshieh <2521628+ydshieh@users.noreply.github.com >
* fix: tokenizer loading.
* fix: json dumping.
* move is_staging_test to a better location.
* better treatment to tokens.
* define repo_id to better handle concurrency
* style
* explicitly set token
* Empty-Commit
* move SUER, TOKEN to test
* collate org_repo_id
* delete repo
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Lucain <lucainp@gmail.com >
Co-authored-by: ydshieh <2521628+ydshieh@users.noreply.github.com >
2023-08-15 07:39:22 +05:30
Lucain
d7280b7436
Trigger CI on ci-* branches ( #3635 )
2023-07-12 19:31:36 +02:00
Patrick von Platen
51593da25a
fix main docs
2023-07-06 19:28:33 +02:00
Patrick von Platen
38e563d0c7
Fix SD XL Docs ( #3971 )
...
* finish sd xl docs
* make style
* Apply suggestions from code review
* uP
* uP
* Correct
2023-07-06 19:21:03 +02:00
Patrick von Platen
187ea539ae
Improve SD XL ( #3968 )
...
* improve sd xl
* correct more
* finish
* make style
* fix more
2023-07-06 18:11:20 +02:00
Patrick von Platen
bc9a8cef6f
[SD-XL] Add new pipelines ( #3859 )
...
* Add new text encoder
* add transformers depth
* More
* Correct conversion script
* Fix more
* Fix more
* Correct more
* correct text encoder
* Finish all
* proof that in works in run local xl
* clean up
* Get refiner to work
* Add red castle
* Fix batch size
* Improve pipelines more
* Finish text2image tests
* Add img2img test
* Fix more
* fix import
* Fix embeddings for classic models (#3888 )
Fix embeddings for classic SD models.
* Allow multiple prompts to be passed to the refiner (#3895 )
* finish more
* Apply suggestions from code review
* add watermarker
* Model offload (#3889 )
* Model offload.
* Model offload for refiner / img2img
* Hardcode encoder offload on img2img vae encode
Saves some GPU RAM in img2img / refiner tasks so it remains below 8 GB.
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* correct
* fix
* clean print
* Update install warning for `invisible-watermark`
* add: missing docstrings.
* fix and simplify the usage example in img2img.
* fix setup for watermarking.
* Revert "fix setup for watermarking."
This reverts commit 491bc9f5a6pedro@huggingface.co >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-07-06 13:37:27 +02:00
Sayak Paul
49949f321d
[Tests] add test for checking soft dependencies. ( #3847 )
...
* add test for checking soft dependencies.
* address patrick's comments.
* dependency tests should not run twice.
* debugging.
* up.
2023-06-28 22:05:25 +05:30
