Commit Graph

9 Commits

Author SHA1 Message Date
Chenlei Hu
3c32cbb0af
Revert "Fix more ruff lint (#139)" (#144)
This reverts commit e13072cb42.
2024-02-08 21:34:58 -05:00
Chenlei Hu
e13072cb42
Fix more ruff lint (#139) 2024-02-08 20:41:38 -05:00
lllyasviel
f06ba8e60b Significantly reduce thread abuse for faster model moving
This will move all major gradio calls into the main thread rather than random gradio threads.
This ensures that all torch.module.to() are performed in main thread to completely possible avoid GPU fragments.
In my test now model moving is 0.7 ~ 1.2 seconds faster, which means all 6GB/8GB VRAM users will get 0.7 ~ 1.2 seconds faster per image on SDXL.
2024-02-08 10:13:59 -08:00
AUTOMATIC1111
0aa7c53c0b fix borked merge, rename fields to better match what they do, change setting default to true for #13653 2024-01-01 16:50:59 +03:00
Anthony Fu
3d15e58b0a feat: refactor 2023-10-16 15:00:17 +08:00
Anthony Fu
8aa13d5dce Interrupt after current generation 2023-10-16 14:12:18 +08:00
w-e-w
cf1edc2b54 initialize state.time_start befroe state.job_count 2023-09-13 16:27:02 +09:00
AUTOMATIC1111
a459075d26 actual solution to the uncommon hanging problem that is seemingly caused by multiple progress requests working on same tensor 2023-08-22 10:41:10 +03:00
AUTOMATIC1111
386245a264 split shared.py into multiple files; should resolve all circular reference import errors related to shared.py 2023-08-09 10:25:35 +03:00