Chanchana Sornsoontorn
52c4d32d41
Fix typo and format BasicTransformerBlock attributes ( #2953 )
...
* ⚙️ chore(train_controlnet) fix typo in logger message
* ⚙️ chore(models) refactor modules order; make them the same as calling order
When printing the BasicTransformerBlock to stdout, I think it's crucial that the attributes order are shown in proper order. And also previously the "3. Feed Forward" comment was not making sense. It should have been close to self.ff but it's instead next to self.norm3
* correct many tests
* remove bogus file
* make style
* correct more tests
* finish tests
* fix one more
* make style
* make unclip deterministic
* ⚙️ chore(models/attention) reorganize comments in BasicTransformerBlock class
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-04-12 00:31:05 +02:00
Will Berman
67ec9cf513
accelerate min version for ProjectConfiguration import ( #3042 )
2023-04-11 10:12:28 -07:00
YiYi Xu
dcfa6e1d20
add Min-SNR loss to Controlnet flax train script ( #3016 )
...
* add wandb team and min-snr loss
* make style
* apply feedbacks
2023-04-10 07:56:54 +05:30
YiYi Xu
2de36fae7b
minor fix in controlnet flax example ( #2986 )
...
* fix the error when push_to_hub but not log validation
* contronet_from_pt & controlnet_revision
* add intermediate checkpointing to the guide
2023-04-06 10:27:41 -10:00
YiYi Xu
ee20d1f8b9
update flax controlnet training script ( #2951 )
...
* load_from_disk + checkpointing_steps
* apply feedback
2023-04-04 15:49:44 -10:00
YiYi Xu
0c63c3839a
allow use custom local dataset for controlnet training scripts ( #2928 )
...
use custom local datset
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-04-04 10:37:47 -07:00
Lucain
a87e88b783
Use upload_folder in training scripts ( #2934 )
...
use upload folder in training scripts
Co-authored-by: testbot <lucainp@hf.co >
2023-04-04 16:19:12 +01:00
Patrick von Platen
a0263b2e5b
make style
2023-04-04 15:18:39 +02:00
Ernie Chu
62c01d267a
Ensure validation image RGB not RGBA ( #2945 )
...
* ensure validation image RGB not RGBA
* ensure validation image RGB not RGBA
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-04-04 14:17:59 +01:00
YiYi Xu
b3d5cc4a36
add flax requirement ( #2894 )
...
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2023-03-30 17:10:26 +01:00
Sayak Paul
d82b032319
[Examples] Add streaming support to the ControlNet training example in JAX ( #2859 )
...
* improve stable unclip doc.
* feat: add streaming support to controlnet flax training script.
* fix: CLI arg.
* fix: torch dataloader shuffle setting.
* fix: dataset length.
* fix: wandb config.
* fix: steps_per_epoch in the training loop.
* add: entry about streaming in the readme
* get column names from iterable dataset + fix final logging
---------
Co-authored-by: yiyixuxu <yixu310@gmail.com >
2023-03-29 06:42:08 +05:30
YiYi Xu
d4f846fa74
[WIP]Flax training script for controlnet ( #2818 )
...
* add train_controlnet_flax
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-03-27 19:13:35 -10:00
Henrik Forstén
79eb3d07d0
Controlnet training ( #2545 )
...
* Controlnet training code initial commit
Works with circle dataset: https://github.com/lllyasviel/ControlNet/blob/main/docs/train.md
* Script for adding a controlnet to existing model
* Fix control image transform
Control image should be in 0..1 range.
* Add license header and remove more unused configs
* controlnet training readme
* Allow nonlocal model in add_controlnet.py
* Formatting
* Remove unused code
* Code quality
* Initialize controlnet in training script
* Formatting
* Address review comments
* doc style
* explicit constructor args and submodule names
* hub dataset
NOTE - not tested
* empty prompts
* add conditioning image
* rename
* remove instance data dir
* image_transforms -> -1,1 . conditioning_image_transformers -> 0, 1
* nits
* remove local rank config
I think this isn't necessary in any of our training scripts
* validation images
* proportion_empty_prompts typo
* weight copying to controlnet bug
* call log validation fix
* fix
* gitignore wandb
* fix progress bar and resume from checkpoint iteration
* initial step fix
* log multiple images
* fix
* fixes
* tracker project name configurable
* misc
* add controlnet requirements.txt
* update docs
* image labels
* small fixes
* log validation using existing models for pipeline
* fix for deepspeed saving
* memory usage docs
* Update examples/controlnet/train_controlnet.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/train_controlnet.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* remove extra is main process check
* link to dataset in intro paragraph
* remove unnecessary paragraph
* note on deepspeed
* Update examples/controlnet/README.md
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* assert -> value error
* weights and biases note
* move images out of git
* remove .gitignore
---------
Co-authored-by: William Berman <WLBberman@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-03-14 20:16:30 -07:00
