YiYi Xu
dcfa6e1d20
add Min-SNR loss to Controlnet flax train script ( #3016 )
...
* add wandb team and min-snr loss
* make style
* apply feedbacks
2023-04-10 07:56:54 +05:30
YiYi Xu
2de36fae7b
minor fix in controlnet flax example ( #2986 )
...
* fix the error when push_to_hub but not log validation
* contronet_from_pt & controlnet_revision
* add intermediate checkpointing to the guide
2023-04-06 10:27:41 -10:00
YiYi Xu
ee20d1f8b9
update flax controlnet training script ( #2951 )
...
* load_from_disk + checkpointing_steps
* apply feedback
2023-04-04 15:49:44 -10:00
YiYi Xu
0c63c3839a
allow use custom local dataset for controlnet training scripts ( #2928 )
...
use custom local datset
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-04-04 10:37:47 -07:00
Lucain
a87e88b783
Use upload_folder in training scripts ( #2934 )
...
use upload folder in training scripts
Co-authored-by: testbot <lucainp@hf.co >
2023-04-04 16:19:12 +01:00
Patrick von Platen
a0263b2e5b
make style
2023-04-04 15:18:39 +02:00
Ernie Chu
62c01d267a
Ensure validation image RGB not RGBA ( #2945 )
...
* ensure validation image RGB not RGBA
* ensure validation image RGB not RGBA
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-04-04 14:17:59 +01:00
YiYi Xu
b3d5cc4a36
add flax requirement ( #2894 )
...
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2023-03-30 17:10:26 +01:00
Sayak Paul
d82b032319
[Examples] Add streaming support to the ControlNet training example in JAX ( #2859 )
...
* improve stable unclip doc.
* feat: add streaming support to controlnet flax training script.
* fix: CLI arg.
* fix: torch dataloader shuffle setting.
* fix: dataset length.
* fix: wandb config.
* fix: steps_per_epoch in the training loop.
* add: entry about streaming in the readme
* get column names from iterable dataset + fix final logging
---------
Co-authored-by: yiyixuxu <yixu310@gmail.com >
2023-03-29 06:42:08 +05:30
YiYi Xu
d4f846fa74
[WIP]Flax training script for controlnet ( #2818 )
...
* add train_controlnet_flax
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-03-27 19:13:35 -10:00
Henrik Forstén
79eb3d07d0
Controlnet training ( #2545 )
...
* Controlnet training code initial commit
Works with circle dataset: https://github.com/lllyasviel/ControlNet/blob/main/docs/train.md
* Script for adding a controlnet to existing model
* Fix control image transform
Control image should be in 0..1 range.
* Add license header and remove more unused configs
* controlnet training readme
* Allow nonlocal model in add_controlnet.py
* Formatting
* Remove unused code
* Code quality
* Initialize controlnet in training script
* Formatting
* Address review comments
* doc style
* explicit constructor args and submodule names
* hub dataset
NOTE - not tested
* empty prompts
* add conditioning image
* rename
* remove instance data dir
* image_transforms -> -1,1 . conditioning_image_transformers -> 0, 1
* nits
* remove local rank config
I think this isn't necessary in any of our training scripts
* validation images
* proportion_empty_prompts typo
* weight copying to controlnet bug
* call log validation fix
* fix
* gitignore wandb
* fix progress bar and resume from checkpoint iteration
* initial step fix
* log multiple images
* fix
* fixes
* tracker project name configurable
* misc
* add controlnet requirements.txt
* update docs
* image labels
* small fixes
* log validation using existing models for pipeline
* fix for deepspeed saving
* memory usage docs
* Update examples/controlnet/train_controlnet.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/train_controlnet.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* remove extra is main process check
* link to dataset in intro paragraph
* remove unnecessary paragraph
* note on deepspeed
* Update examples/controlnet/README.md
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* assert -> value error
* weights and biases note
* move images out of git
* remove .gitignore
---------
Co-authored-by: William Berman <WLBberman@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-03-14 20:16:30 -07:00
