Sayak Paul
|
e6639fef70
|
[benchmarks] overhaul benchmarks (#11565)
* start overhauling the benchmarking suite.
* fixes
* fixes
* checking.
* checking
* fixes.
* error handling and logging.
* add flops and params.
* add more models.
* utility to fire execution of all benchmarking scripts.
* utility to push to the hub.
* push utility improvement
* seems to be working.
* okay
* add torchprofile dep.
* remove total gpu memory
* fixes
* fix
* need a big gpu
* better
* what's happening.
* okay
* separate requirements and make it nightly.
* add db population script.
* update secret name
* update secret.
* population db update
* disable db population for now.
* change to every monday
* Update .github/workflows/benchmark.yml
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
* quality improvements.
* reparate hub upload step.
* repository
* remove csv
* check
* update
* update
* threading.
* update
* update
* updaye
* update
* update
* update
* remove peft dep
* upgrade runner.
* fix
* fixes
* fix merging csvs.
* push dataset to the Space repo for analysis.
* warm up.
* add a readme
* Apply suggestions from code review
Co-authored-by: Luc Georges <McPatate@users.noreply.github.com>
* address feedback
* Apply suggestions from code review
* disable db workflow.
* update to bi weekly.
* enable population
* enable
* updaye
* update
* metadata
* fix
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
Co-authored-by: Luc Georges <McPatate@users.noreply.github.com>
|
2025-07-04 11:04:17 +05:30 |
|
Sayak Paul
|
83b112a145
|
shift cache in benchmarking. (#8740)
* shift cache.
* comment
|
2024-07-01 07:14:05 +05:30 |
|
Sayak Paul
|
7db8c3ec40
|
Benchmarking workflow fix (#8389)
* fix
* fixes
* add back the deadsnakes
* better messaging
* disable IP adapter tests for the moment.
* style
* up
* empty
|
2024-06-29 09:06:32 +05:30 |
|
Sayak Paul
|
03cd62520f
|
feat: add ip adapter benchmark (#6936)
* feat: add ip adapter benchmark
* sdxl support too.
* Empty-Commit
|
2024-03-03 15:10:55 +05:30 |
|
Sayak Paul
|
1d686bac81
|
[feat: Benchmarking Workflow] add stuff for a benchmarking workflow (#5839)
* add poc for benchmarking workflow.
* import
* fix argument
* fix: argument
* fix: path
* fix
* fix
* path
* output csv files.
* workflow cleanup
* append token
* add utility to push to hf dataset
* fix: kw arg
* better reporting
* fix: headers
* better formatting of the numbers.
* better type annotation
* fix: formatting
* moentarily disable check
* push results.
* remove disable check
* introduce base classes.
* img2img class
* add inpainting pipeline
* intoduce base benchmark class.
* add img2img and inpainting
* feat: utility to compare changes
* fix
* fix import
* add args
* basepath
* better exception handling
* better path handling
* fix
* fix
* remove
* ifx
* fix
* add: support for controlnet.
* image_url -> url
* move images to huggingface hub
* correct urls.
* root_ckpt
* flush before benchmarking
* don't install accelerate from source
* add runner
* simplify Diffusers Benchmarking step
* change runner
* fix: subprocess call.
* filter percentage values
* fix controlnet benchmark
* add t2i adapters.
* fix filter columns
* fix t2i adapter benchmark
* fix init.
* fix
* remove safetensors flag
* fix args print
* fix
* feat: run_command
* add adapter resolution mapping
* benchmark t2i adapter fix.
* fix adapter input
* fix
* convert to L.
* add flush() add appropriate places
* better filtering
* okay
* get env for torch
* convert to float
* fix
* filter out nans.
* better coment
* sdxl
* sdxl for other benchmarks.
* fix: condition
* fix: condition for inpainting
* fix: mapping for resolution
* fix
* include kandinsky and wuerstchen
* fix: Wuerstchen
* Empty-Commit
* [Community] AnimateDiff + Controlnet Pipeline (#5928)
* begin work on animatediff + controlnet pipeline
* complete todos, uncomment multicontrolnet, input checks
Co-Authored-By: EdoardoBotta <botta.edoardo@gmail.com>
* update
Co-Authored-By: EdoardoBotta <botta.edoardo@gmail.com>
* add example
* update community README
* Update examples/community/README.md
---------
Co-authored-by: EdoardoBotta <botta.edoardo@gmail.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
* EulerDiscreteScheduler add `rescale_betas_zero_snr` (#6024)
* EulerDiscreteScheduler add `rescale_betas_zero_snr`
* Revert "[Community] AnimateDiff + Controlnet Pipeline (#5928)"
This reverts commit 821726d7c0.
* Revert "EulerDiscreteScheduler add `rescale_betas_zero_snr` (#6024)"
This reverts commit 3dc2362b5a.
* add SDXL turbo
* add lcm lora to the mix as well.
* fix
* increase steps to 2 when running turbo i2i
* debug
* debug
* debug
* fix for good
* fix and isolate better
* fuse lora so that torch compile works with peft
* fix: LCMLoRA
* better identification for LCM
* change to cron job
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
Co-authored-by: Aryan V S <contact.aryanvs@gmail.com>
Co-authored-by: EdoardoBotta <botta.edoardo@gmail.com>
Co-authored-by: Beinsezii <39478211+Beinsezii@users.noreply.github.com>
|
2023-12-12 11:03:34 +05:30 |
|