lllyasviel
f06ba8e60b
Significantly reduce thread abuse for faster model moving
...
This will move all major gradio calls into the main thread rather than random gradio threads.
This ensures that all torch.module.to() are performed in main thread to completely possible avoid GPU fragments.
In my test now model moving is 0.7 ~ 1.2 seconds faster, which means all 6GB/8GB VRAM users will get 0.7 ~ 1.2 seconds faster per image on SDXL.
2024-02-08 10:13:59 -08:00
lllyasviel
27d815618d
remove xformer prints
2024-02-04 18:27:25 -08:00
lllyasviel
66187d97fb
early initilize
2024-01-31 15:27:13 -08:00
lllyasviel
fd75f4f101
Merge branch 'main' into dev
2024-01-31 13:19:08 -08:00
wangshuai09
cc3f604310
Update
2024-01-31 12:29:58 +08:00
wangshuai09
74ff85a1a1
Merge branch 'dev' into npu_support
2024-01-30 19:15:41 +08:00
wangshuai09
ec124607f4
Add NPU Support
2024-01-29 19:25:06 +08:00
lllyasviel
b731bb860c
Update webui.py
...
i
Update initialization.py
initialization
initialization
Update initialization.py
i
i
Update sd_samplers_common.py
Update sd_hijack.py
i
Update sd_models.py
Update sd_models.py
Update forge_loader.py
Update sd_models.py
i
Update sd_model.py
i
Update sd_models.py
Create sd_model.py
i
i
Update sd_models.py
i
Update sd_models.py
Update sd_models.py
i
i
Update sd_samplers_common.py
i
Update sd_models.py
Update sd_models.py
Update sd_samplers_common.py
Update sd_models.py
Update sd_models.py
Update sd_models.py
Update sd_models.py
Update sd_samplers_common.py
i
Update shared_options.py
Update prompt_parser.py
Update sd_hijack_unet.py
i
Update sd_models.py
Update sd_models.py
Update sd_models.py
Update devices.py
i
Update sd_vae.py
Update sd_models.py
Update processing.py
Update ui_settings.py
Update sd_models_xl.py
i
i
Update sd_samplers_kdiffusion.py
Update sd_samplers_timesteps.py
Update ui_settings.py
Update cmd_args.py
Update cmd_args.py
Update initialization.py
Update shared_options.py
Update initialization.py
Update shared_options.py
i
Update cmd_args.py
Update initialization.py
Update initialization.py
Update initialization.py
Update cmd_args.py
Update cmd_args.py
Update sd_hijack.py
2024-01-16 02:33:39 -08:00
Aarni Koskela
9805f35c6f
Ensure GRADIO_ANALYTICS_ENABLED is set early enough
2024-01-04 19:13:47 +02:00
Aarni Koskela
5fbb13e0da
Remove cleanup_models
code
2023-12-30 20:47:12 +02:00
Leon
ab3d3528a1
add --skip-load-model-at-start
2023-09-14 18:42:56 +08:00
AUTOMATIC1111
95821f0132
split webui.py's initialization and utility functions into separate files
2023-08-09 18:11:13 +03:00