174 Commits

Author	SHA1	Message	Date
Vladimir Mandic	b37c6115ff	fix sd3 loader ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-10-22 12:49:07 -04:00
Vladimir Mandic	c2ab0b11c3	check te device ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-10-14 09:29:33 -04:00
Vladimir Mandic	bd6e689bd1	fix te meta ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-10-01 21:26:21 -04:00
Vladimir Mandic	9a46d381cc	cleanups ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-10-01 20:02:21 -04:00
Vladimir Mandic	f9b5a83b49	cleanup ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-10-01 12:20:32 -04:00
Vladimir Mandic	046d588de2	add fix-te ... Signed-off-by: Vladimir Mandic <mandic00@live.com>	2024-10-01 12:12:10 -04:00
Vladimir Mandic	92f2a2902f	improve profiling	2024-09-23 11:07:24 -04:00
Vladimir Mandic	b9e230c17f	update logging	2024-09-22 11:17:06 -04:00
Vladimir Mandic	6919ca310a	lint updates	2024-09-21 15:44:53 -04:00
Vladimir Mandic	2be087be38	embeds addiotional checks	2024-09-18 21:46:19 -04:00
Vladimir Mandic	8bd944d48b	add move-te	2024-09-18 16:02:20 -04:00
Vladimir Mandic	edd92c604e	fix	2024-09-18 15:51:26 -04:00
Vladimir Mandic	2acb883dda	jumbo update, see changelog	2024-09-18 13:48:30 -04:00
Vladimir Mandic	0d9ce663e4	post release dev merge, see changelog for details	2024-09-01 12:20:10 -04:00
Vladimir Mandic	2c8cb5cd67	vae exception handling	2024-08-29 17:46:32 -04:00
Vladimir Mandic	0b901e08ce	xhinker move te as needed	2024-08-29 10:42:38 -04:00
Vladimir Mandic	707fc1de79	flux prompt attention	2024-08-28 08:34:42 -04:00
AI-Casanova	1de7716495	Remove print commands	2024-08-25 18:27:30 -05:00
AI-Casanova	517ee93e96	xhinker parser implementation	2024-08-25 18:23:45 -05:00
Disty0	c1285c6de6	Cascade re-add empty embed provider	2024-08-23 07:09:05 +03:00
Disty0	02d6b674c6	Cascade decide atten mask value from the model name	2024-08-23 02:53:39 +03:00
Disty0	8619a7f35c	Better balanced offload	2024-08-14 11:53:35 +03:00
Disty0	70c2e84d26	Prompt cache support for Flux	2024-08-12 01:02:13 +03:00
Disty0	e3b087b6c0	Add balanced offload mode and make offload modes a single choice list	2024-08-11 17:27:30 +03:00
Disty0	6431296ec1	Fix Cascade empty prompt encode	2024-08-09 00:32:19 +03:00
Disty0	a17e452db2	Fix Cascade with long prompts	2024-08-07 01:32:09 +03:00
Vladimir Mandic	2cac5f365d	update	2024-07-02 11:28:14 -04:00
Disty0	61d4acda68	SD3 send TE back to CPU when using cpu offload	2024-06-23 15:22:34 +03:00
Disty0	4d0ba8692a	Add gc to prompt parser	2024-06-23 04:50:30 +03:00
Disty0	3856cb213a	Fix SD3 prompt parser with offload	2024-06-22 15:43:58 +03:00
Vladimir Mandic	323b20813a	fix prompt parsing	2024-06-21 08:58:33 -04:00
Vladimir Mandic	6b6170bfaa	Merge branch 'dev' into SD3-parsing	2024-06-21 08:16:44 -04:00
Vladimir Mandic	4e80e6c40c	add option to disable text-encoder cache	2024-06-20 11:46:38 -04:00
Vladimir Mandic	9be91e2e2d	update notes	2024-06-20 09:01:24 -04:00
AI-Casanova	1fcd378bd1	Merge branch 'dev' into SD3-parsing	2024-06-19 23:47:17 -05:00
AI-Casanova	e3009753e3	Finish SD3 Prompt Parsing, reconfigure Compel Hijack	2024-06-19 23:41:11 -05:00
Vladimir Mandic	ed8d2ee1d8	update changelog	2024-06-17 19:22:32 -04:00
AI-Casanova	d3802f9fbc	SD3 Prompt Parsing, preliminary	2024-06-16 18:00:30 -05:00
Disty0	5f41181576	Cascade normalize padding and replace empty embed option with zeros	2024-06-13 03:13:45 +03:00
Vladimir Mandic	a20103a86c	add prompt attention normalization	2024-06-10 15:48:55 -04:00
Disty0	38c6dbdd4a	Don't force empty padding on Cascade	2024-06-10 18:36:57 +03:00
Disty0	4f482986d1	Add empty prompt padding option	2024-06-10 17:59:07 +03:00
Vladimir Mandic	5574833f0d	refactor backend detection	2024-06-06 20:41:10 -04:00
Vladimir Mandic	9bc217644d	improve metadata parser	2024-06-06 11:24:31 -04:00
Vladimir Mandic	8a9c10e665	hidiffusion disable embeds cache	2024-06-05 17:36:43 -04:00
Disty0	887de74d22	Fix Cascade overcooking with more than 75 tokens	2024-05-31 18:40:39 +03:00
Disty0	3ebe2ab469	Fix prompt cache with clip skip	2024-05-26 18:15:38 +03:00
Disty0	be264d14d6	Stable Cascade prompt parser support	2024-05-26 16:01:27 +03:00
Vladimir Mandic	41efd6584d	fix cached prompts	2024-05-24 09:46:18 -04:00
Vladimir Mandic	49c997e20f	handle unknown tokens	2024-05-21 16:59:16 -04:00