93 Commits

Author	SHA1	Message	Date
Disty0	e49814098e	Add sdnq_modules_dtype_dict	2025-08-20 14:58:54 +03:00
Disty0	0946710662	Add sdnq_modules_to_not_convert to UI settings	2025-08-20 04:38:20 +03:00
Disty0	8ca74d0cd2	SDNQ rename unused param_name arg to op	2025-08-13 22:10:30 +03:00
Disty0	15cb8fe9f8	SDNQ add modules_dtype_dict and fix Qwen Image with quants less than 5 bits	2025-08-13 00:07:36 +03:00
Vladimir Mandic	87bd347116	cleanup flux loader ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-08-11 16:05:39 -04:00
Disty0	afb3a5a06d	SDNQ move non_blocking to quant config	2025-08-11 15:07:02 +03:00
Vladimir Mandic	6a6605191f	configurable image fit in all image views ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-08-06 11:33:50 -04:00
Vladimir Mandic	7bba30e797	sdnq obey diffusers_to_gpu ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-08-06 10:12:27 -04:00
Vladimir Mandic	ba4bff08d6	remove ldsr and refactor sdnq device map ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-08-06 09:27:54 -04:00
Vladimir Mandic	4be093b80f	add diffusers_offload_nonblocking setting ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-08-01 16:38:31 -04:00
Vladimir Mandic	b291c337a1	refactor internal post loop ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-08-01 10:45:39 -04:00
Vladimir Mandic	fa44521ea3	offload-never and offload-always per-module and new highvram profile ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-07-31 11:40:24 -04:00
Vladimir Mandic	052f097956	lint ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-07-30 13:14:04 -04:00
Disty0	f02cfeaef9	Rename SDNQ TE dtype default to Same as model	2025-07-27 23:06:41 +03:00
Vladimir Mandic	b5a87c4828	modify installer checks ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-07-26 18:40:28 -04:00
Vladimir Mandic	ed1e59464e	update requirements ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-07-06 14:53:25 -04:00
Vladimir Mandic	2b9056179d	add lbm background replace with relightining ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-07-04 15:33:16 -04:00
Disty0	4aeb9f004c	Cleanup layerwise	2025-07-04 06:12:25 +03:00
Disty0	9d5571f4f8	Use layerwise casting with Flux FP8 models	2025-07-04 04:26:43 +03:00
Disty0	fe9a3b8506	Add device map support to Flux and Chroma and add custom UNet support to Chroma	2025-07-04 02:22:42 +03:00
Disty0	cf90e5621a	Add _skip_layerwise_casting_patterns to SDNQ skip list	2025-07-04 00:04:01 +03:00
Vladimir Mandic	c4d9338d2e	major refactoring of modules ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-07-03 09:18:38 -04:00
Disty0	71f7474de2	Unify quant options	2025-06-27 21:05:14 +03:00
Disty0	3b8ced444c	Add auto quantization mode	2025-06-27 18:54:15 +03:00
Disty0	0e4d712f27	Chroma fixes	2025-06-26 21:25:50 +03:00
Enes Sadık Özbek	e91208bea9	Merge branch 'dev' into feature/chroma-support	2025-06-26 17:02:00 +03:00
Disty0	0f6eb624c9	Use llm_int8_skip_modules with bnb	2025-06-26 03:10:26 +03:00
Disty0	dc8fd006b2	Add modules_to_not_convert to pre-mode quants	2025-06-26 02:47:10 +03:00
Enes Sadık Özbek	21bdde12d3	Merge branch 'dev' into feature/chroma-support	2025-06-26 01:56:34 +03:00
Disty0	c25d15398f	SDNQ pre-mode don't quant if weights_dtype == 'none'	2025-06-26 01:48:01 +03:00
Disty0	81e55f0459	Fix SDNQ pre-mode	2025-06-25 22:58:40 +03:00
Vladimir Mandic	5b486a6ef1	sdnq add xyz grid support, improve offloading compatibility ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-06-25 15:32:37 -04:00
Disty0	87e6d3f4fc	SDNQ add modules_to_not_convert and don't quant _keep_in_fp32_modules layers in post mode	2025-06-20 20:41:11 +03:00
Disty0	2c4850cc2b	Log more info with SDNQ	2025-06-18 18:03:46 +03:00
Disty0	86cd272b96	SDNQ fix Dora	2025-06-18 16:24:42 +03:00
Enes Sadık Özbek	4b3ce06916	Initial support for Chroma	2025-06-18 00:38:17 +00:00
Disty0	25fc0094a9	SDNQ use quantize_device and return_device args and fix decompress_fp32 always being on	2025-06-14 21:29:08 +03:00
Disty0	2ba64abcde	Cleanup	2025-06-14 00:54:18 +03:00
Disty0	cb4684cbeb	SNDQ add separate quant mode option for Text Encoders	2025-06-13 12:42:57 +03:00
Disty0	5eed9135e3	Split SDNQ into multiple files and linting	2025-06-10 03:18:25 +03:00
Disty0	976f0ba61f	Cleanup	2025-06-05 20:59:58 +03:00
Disty0	d8e8f47ce5	SDNQ add an option to toggle quantize with GPU	2025-05-28 15:18:39 +03:00
Disty0	4ed15f5cce	SDNQ revert device_map = gpu	2025-05-27 23:32:58 +03:00
Disty0	d3e3fb98b0	Don't override user set device_map	2025-05-27 21:45:52 +03:00
Disty0	b1b29e9001	SDNQ disable device_map = gpu with TE and LLM	2025-05-27 21:32:32 +03:00
Disty0	3618e39cff	SDNQ use device_map = gpu	2025-05-27 19:46:30 +03:00
Disty0	dece497f10	Refactor SDNQ to use weights_dtype and rename decompress_int8_matmul to use_quantized_matmul	2025-05-27 15:49:21 +03:00
Disty0	4453efee76	Rename NNCF to SDNQ and rename quant schemes	2025-05-26 02:39:51 +03:00
Disty0	2d79380bd7	NNCF implement better layer hijacks and remove all NNCF imports	2025-05-26 01:12:28 +03:00
Vladimir Mandic	bfda37903c	update nncf linting and changelog ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2025-05-13 12:11:10 -04:00