Even_Adder@lemmy.dbzer0.com to Stable Diffusion@lemmy.dbzer0.com • 2 months agoStable Diffusion 3 Medium Fine-tuning Tutorial — Stability AIexternal-linkmessage-square8 fedilinkarrow-up17
arrow-up17external-linkStable Diffusion 3 Medium Fine-tuning Tutorial — Stability AIEven_Adder@lemmy.dbzer0.com to Stable Diffusion@lemmy.dbzer0.com • 2 months agomessage-square8 Commentsfedilink
minus-squareEven_Adder@lemmy.dbzer0.comhexagonhexbear1·2 months agoLast I heard, LoRAs cause catastrophic forgetting in the model, and full fine-tuning doesn't really work. linkfedilink
minus-squareclb92@feddit.dkhexbear2·2 months agoOh well, in practice I'll just continue to enjoy this (possibly forgetful and not-fully-finetunable) model then, that still gives me amazing results 😊 linkfedilink
minus-squareerenkoylu@lemmy.mlhexbear1·edit-22 months agoquite the opposite. Lora's are very effective against catastrophic forgetting, and full finetuning is very dangerous (but also much more powerful). linkfedilink
Last I heard, LoRAs cause catastrophic forgetting in the model, and full fine-tuning doesn't really work.
Oh well, in practice I'll just continue to enjoy this (possibly forgetful and not-fully-finetunable) model then, that still gives me amazing results 😊
quite the opposite. Lora's are very effective against catastrophic forgetting, and full finetuning is very dangerous (but also much more powerful).