Used <a target="_blank" rel="ugc" href="https://civarchive.com/user/seruva19">https://civarchive.com/user/seruva19</a> 's Ghibli dataset. 120 images, batch size 4, 100 epochs, 3000 steps. Learning rate: 1e-5. 13 hours running on 2 x rtx 5000 ada gpus. I used diffusion-pipeline since it allows distributing loads across multiple gpu's.*Update V2.0 I doubled the lr rate to 2e-5 to make a more potent LORA.Image2Image guidance: If you want to do img2img, I recommend setting sampler = lcm and scheduler = linear_quadratic. The denoise will be between .3 - .4 and steps around 5-10. Will need to adjust on a case by case basis.

Studio Ghibli

I upped the LR to 2e-5 (double the previous) and the training a bit longer 112 epochs. This Lora is much stronger than the previous one.

Files with SHA256: 1f6b45e71c86be68c40f2197f82d78a57d1b65f54f0485ba56c7d5fde03827ea