Commit Graph

290 Commits

Author SHA1 Message Date
v0xie
f6c8201e56 refactor: move factorization to lyco_helpers, separate calc_updown for kohya and kb 2023-11-03 19:35:15 -07:00
v0xie
fe1967a4c4 skip multihead attn for now 2023-11-03 17:52:55 -07:00
v0xie
d727ddfccd no idea what i'm doing, trying to support both type of OFT, kblueleaf diag_oft has MultiheadAttn which kohya's doesn't?, attempt create new module based off network_lora.py, errors about tensor dim mismatch 2023-11-02 00:13:11 -07:00
v0xie
65ccd6305f detect diag_oft type 2023-11-02 00:11:32 -07:00
v0xie
a2fad6ee05 test implementation based on kohaku diag-oft implementation 2023-11-01 22:34:27 -07:00
v0xie
6523edb8a4 style: conform style 2023-10-22 09:31:15 -07:00
v0xie
3b8515d2c9 fix: multiplier applied twice in finalize_updown 2023-10-22 09:27:48 -07:00
v0xie
4a50c9638c refactor: remove used OFT functions 2023-10-22 08:54:24 -07:00
v0xie
de8ee92ed8 fix: use merge_weight to cache value 2023-10-21 17:37:17 -07:00
v0xie
76f5abdbdb style: cleanup oft 2023-10-21 16:07:45 -07:00
v0xie
fce86ab7d7 fix: support multiplier, no forward pass hook 2023-10-21 16:03:54 -07:00
v0xie
7683547728 fix: return orig weights during updown, merge weights before forward 2023-10-21 14:42:24 -07:00
v0xie
2d8c894b27 refactor: use forward hook instead of custom forward 2023-10-21 13:43:31 -07:00
v0xie
0550659ce6 style: fix ambiguous variable name 2023-10-19 13:13:02 -07:00
v0xie
d10c4db57e style: formatting 2023-10-19 12:52:14 -07:00
v0xie
321680ccd0 refactor: fix constraint, re-use get_weight 2023-10-19 12:41:17 -07:00
Kohaku-Blueleaf
7c128bbdac Add fp8 for sd unet 2023-10-19 13:56:17 +08:00
v0xie
eb01d7f0e0 faster by calculating R in updown and using cached R in forward 2023-10-18 04:56:53 -07:00
v0xie
853e21d98e faster by using cached R in forward 2023-10-18 04:27:44 -07:00
v0xie
1c6efdbba7 inference working but SLOW 2023-10-18 04:16:01 -07:00
v0xie
ec718f76b5 wip incorrect OFT implementation 2023-10-17 23:35:50 -07:00
AUTOMATIC1111
4be7b620c2
Merge pull request #13568 from AUTOMATIC1111/lora_emb_bundle
Add lora-embedding bundle system
2023-10-14 12:18:55 +03:00
AUTOMATIC1111
a8cbe50c9f remove duplicated code 2023-10-14 12:17:59 +03:00
v0xie
906d1179e9 support inference with LyCORIS GLora networks 2023-10-11 21:26:58 -07:00
Kohaku-Blueleaf
891ccb767c Fix lint 2023-10-10 15:07:25 +08:00
Kohaku-Blueleaf
81e94de318 Add warning when meet emb name conflicting
Choose standalone embedding (in /embeddings folder) first
2023-10-10 14:44:20 +08:00
Kohaku-Blueleaf
2282eb8dd5 Remove dev debug print 2023-10-10 12:11:00 +08:00
Kohaku-Blueleaf
3d8b1af6be Support string_to_param nested dict
format:
bundle_emb.EMBNAME.string_to_param.KEYNAME
2023-10-10 12:09:33 +08:00
Kohaku-Blueleaf
2aa485b5af add lora bundle system 2023-10-09 22:52:09 +08:00
w-e-w
74b80e7211 add comment 2023-09-12 09:29:07 +09:00
w-e-w
e785402b6a return nothing if not found 2023-09-11 19:37:55 +09:00
dongwenpu
7d4d871d46 fix: lora-bias-backup don't reset cache 2023-09-10 17:53:42 +08:00
w-e-w
f5959c1c30 thread safe extra network using list 2023-09-09 17:05:50 +09:00
w-e-w
25de9a785c Revert "thread safe extra network list_items"
This reverts commit aab385d01b.
2023-09-09 16:56:19 +09:00
w-e-w
aab385d01b thread safe extra network list_items 2023-09-03 11:56:02 +09:00
bluelovers
d83a1ba65b feat: display file metadata ss_output_name
https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/12289
2023-08-29 06:33:00 +08:00
Danil Boldyrev
c39efa6ba6 Zoom and Pan: Resize handler 2023-08-24 17:30:35 +03:00
Danil Boldyrev
fa68d66c98 remove console.log 2023-08-24 01:42:37 +03:00
Danil Boldyrev
32e790a47e Fixing and improving integration 2023-08-24 01:40:06 +03:00
Danil Boldyrev
6a87e35bef lint 2023-08-23 03:35:09 +03:00
Danil Boldyrev
8fd1558179 Removed the old code 2023-08-23 03:21:28 +03:00
Danil Boldyrev
54fbdcf467 Improve integration, fix for new gradio 2023-08-22 16:43:23 +03:00
AUTOMATIC1111
df595ae313 make resize handle available to extensions 2023-08-21 08:48:46 +03:00
AUTOMATIC1111
4a2bf65fea make mobile built-in extension actually do something 2023-08-20 13:40:11 +03:00
AUTOMATIC1111
db5c304e29 make live previews play nice with window/slider resizes 2023-08-20 13:38:35 +03:00
catboxanon
a3c8510c05 Add resize-handler extension 2023-08-20 02:31:32 -04:00
AUTOMATIC1111
86221269f9 RAM optimization round 2 2023-08-16 09:55:35 +03:00
AUTOMATIC1111
85fcb7b8df lint 2023-08-15 19:25:03 +03:00
AUTOMATIC1111
8b181c812f
Merge pull request #12584 from AUTOMATIC1111/full-module-with-bias
Add ex_bias into full module
2023-08-15 19:24:15 +03:00
AUTOMATIC1111
f01682ee01 store patches for Lora in a specialized module 2023-08-15 19:23:40 +03:00
Kohaku-Blueleaf
aa57a89a21 full module with ex_bias 2023-08-15 23:41:46 +08:00
w-e-w
a2e213bc7b separate Extra options 2023-08-14 18:50:22 +09:00
Kohaku-Blueleaf
f70ded8936 remove "if bias exist" check 2023-08-14 13:53:40 +08:00
Kohaku-Blueleaf
e7c03ccdce Merge branch 'dev' into extra-norm-module 2023-08-14 13:34:51 +08:00
Kohaku-Blueleaf
d9cc27cb29 Fix MHA updown err and support ex-bias for no-bias layer 2023-08-14 13:32:51 +08:00
AUTOMATIC1111
1c6ca09992
Merge pull request #12510 from catboxanon/feat/extnet/hashes
Support search and display of hashes for all extra network items
2023-08-13 16:46:32 +03:00
AUTOMATIC1111
db40d26d08 linter 2023-08-13 16:38:10 +03:00
AUTOMATIC1111
d8419762c1 Lora: output warnings in UI rather than fail for unfitting loras; switch to logging for error output in console 2023-08-13 15:07:37 +03:00
catboxanon
7fa5ee54b1 Support search and display of hashes for all extra network items 2023-08-13 02:32:54 -04:00
Kohaku-Blueleaf
5881dcb887 remove debug print 2023-08-13 02:36:02 +08:00
Kohaku-Blueleaf
a2b8305096 return None if no ex_bias 2023-08-13 02:35:04 +08:00
Kohaku-Blueleaf
bd4da4474b Add extra norm module into built-in lora ext
refer to LyCORIS 1.9.0.dev6
add new option and module for training norm layer
(Which is reported to be good for style)
2023-08-13 02:27:39 +08:00
AUTOMATIC1111
3c00e41ec0
Merge pull request #12458 from daswer123/auto-expand
Zoom and pan: Some fixes for the auto-expand
2023-08-11 07:56:31 +03:00
catboxanon
4fafc34e49 Fix to make LoRA old method setting work 2023-08-10 23:42:58 -04:00
Danil Boldyrev
045f740892 Height fix 2023-08-10 16:17:52 +03:00
Danil Boldyrev
ed01d2ee3b a another fix, a different approach 2023-08-10 13:45:25 +03:00
AUTOMATIC1111
c7b9394daf
Merge pull request #12435 from daswer123/auto-expand
Zoom and pan: fix auto-expand
2023-08-09 20:04:44 +03:00
Danil Boldyrev
4a64d34001 fix auto-expand 2023-08-09 18:40:45 +03:00
AUTOMATIC1111
eed963e972 Lora cache in memory 2023-08-09 16:54:49 +03:00
Danil Boldyrev
e12a1be1ca auto-expand enable by default for js 2023-08-09 00:14:19 +03:00
Danil Boldyrev
a74c014425 auto-expand enable by default 2023-08-09 00:06:51 +03:00
Danil Boldyrev
bc7906e6d6 Ability to automatically expand a picture that does not fit in the screen 2023-08-08 21:28:16 +03:00
AUTOMATIC1111
01997f45ba fix extra_options_section misbehaving when there's just one extra_options element 2023-08-07 18:49:23 +03:00
AUTOMATIC1111
4c72377bbf Options in main UI update
- correctly read values from pasted infotext
- setting for column count
- infotext paste: do not add a field to override settings if some other component is already handling it
2023-08-07 09:42:13 +03:00
w-e-w
7a64601428 need Reload UI not Restart 2023-08-05 14:21:28 +09:00
AUTOMATIC1111
362789a379 gradio 3.39 2023-08-04 08:04:23 +03:00
AUTOMATIC1111
91a131aa6c update lora extension to work with python 3.8 2023-07-27 09:00:47 +03:00
AUTOMATIC1111
d0bf509fa1 fix for #11963 2023-07-25 16:18:10 +03:00
catboxanon
a68f469030
Fix to parse TE in some LoRAs 2023-07-24 17:54:59 -04:00
AUTOMATIC1111
b010eea520 fix incorrect multiplier for Loras 2023-07-19 00:41:00 +03:00
AUTOMATIC1111
136c8859a4 add backwards compatibility --lyco-dir-backcompat option, use that for LyCORIS directory instead of hardcoded value
prevent running preload.py for disabled extensions
2023-07-18 20:11:30 +03:00
AUTOMATIC1111
4b5a63aa11 add a bit more metadata info for the lora user metadata page 2023-07-18 17:32:46 +03:00
Kohaku-Blueleaf
3d31caf4a5
use "is not None" for Tensor 2023-07-18 10:45:42 +08:00
Kohaku-Blueleaf
17e14ed2d9
Fix wrong key name in lokr module 2023-07-18 10:23:41 +08:00
AUTOMATIC1111
699108bfbb hide cards for networks of incompatible stable diffusion version in Lora extra networks interface 2023-07-17 18:56:22 +03:00
AUTOMATIC1111
2164578738
Merge pull request #11821 from AUTOMATIC1111/lora_lyco
lora extension rework to include other types of networks
2023-07-17 15:51:59 +03:00
AUTOMATIC1111
05d23c7837 move generate button below the picture for mobile clients 2023-07-17 11:44:29 +03:00
AUTOMATIC1111
35510f7529 add alias to lyco network
read networks from LyCORIS dir if it exists
add credits
2023-07-17 10:06:02 +03:00
AUTOMATIC1111
2e07a8ae6b some backwards compatibility
linter
2023-07-17 09:05:18 +03:00
AUTOMATIC1111
238adeaffb support specifying te and unet weights separately
update lora code
support full module
2023-07-17 09:00:47 +03:00
AUTOMATIC1111
46466f09d0 Lokr support 2023-07-17 00:29:07 +03:00
AUTOMATIC1111
58c3df32f3 IA3 support 2023-07-17 00:12:18 +03:00
AUTOMATIC1111
ef5dac7786 fix 2023-07-17 00:01:17 +03:00
AUTOMATIC1111
c2297b89d3 linter 2023-07-16 23:14:57 +03:00
AUTOMATIC1111
b75b004fe6 lora extension rework to include other types of networks 2023-07-16 23:13:55 +03:00
AUTOMATIC1111
0198eaec45
Merge pull request #11757 from AUTOMATIC1111/sdxl
SD XL support
2023-07-16 12:04:53 +03:00
AUTOMATIC1111
7b052eb70e add resolution calculation from buckets for lora user metadata page 2023-07-16 10:07:02 +03:00
AUTOMATIC1111
47d9dd0240 speedup extra networks listing 2023-07-16 09:25:32 +03:00
AUTOMATIC1111
a1d6ada69a allow refreshing single card after editing user metadata instead of all cards 2023-07-16 08:38:23 +03:00
AUTOMATIC1111
11f339733d add lora user metadata editor dialog inspired by MrKuenning's mockup from #7458 2023-07-16 00:57:45 +03:00