This DoRA is trained on a 1.5k images of varying belly shapes and belly clothing states for noob_vpred. I felt like it was better to combine and improve my existing belly shape LoRAs into one for ease of use and training. Not to mention noob_vpred training results are just better than pony.
Update 2025/02/17:
forgot to upload v4 weeks ago, but this new version is just better at all shapes. Use the same tags as v3.
This was really just a test of a new optimizer ADOPT mixed with learned_timestep_loss_weighting, trying to find the best combination to make it work. There is still room for improvement, but this was the best of 1.5 weeks worth of test runs, lol
Important tags (same as Hyperfusion tags):
torpedo belly
sagging belly
distended belly (when the sides or ribs are being stretched by belly)
spherical belly
stuffed belly (the top half of the belly is same or larger than the bottom)
wide belly (only works with straight-on poses)
to a lesser extent:
low navel (navel is placed low on the belly)
hanging belly (unlike sagging, the character must be bent over in some way)
exposed belly
clothed belly
innie navel
outie navel
prey shaped belly (didn't learn well)
Probably others I haven't tested yet from the hyperfusion tags list
belly_sizes:
medium belly
big belly
huge belly
gigantic belly
hyper belly
hyper pregnancy
obviously some belly tags the model already knows were also included:
pregnant belly
bloated belly
chubby belly
etc...
Description
This is the first version of an all-in-one DoRA for belly shapes. I may add more shapes in the future, but 200 images per shape adds a decent amount of training time for each additional.
1.5k images, extracted from my hyperfusion dataset, so you can use most belly related tags from that.
Training notes:
Kohya's trainer
optimizer ADOPT
optimizer_args
"decouple=True" "weight_decay=0.01" "betas=(0.9, 0.999)" "eps=1e-7"
DoRa LoCon
frozen text encoder (increased training time, but I prefer to not touch the TE if possible)
lr 4e-4
dim 16
alpha 8
conv_dim 8
conv_alpha 4
batch 8
GA 4
1.5k images
flip
bucket
resolution 1024
tag dropout 0.1
dropout 0.2
caption_dropout 0.1
scale_weight_norms 10
ip_noise_gamma 0.02
min_snr_gamma 2
zsnr
v_pred
Extras:
soft_min_snr instead of the default formula
learned timestep loss weights, a small network to learn the loss scale for each timestep. similar goal to min_snr
sort important tags to the front and sort separately from others
tag implication dropout for all common implied tags ~40% drop
FAQ
Comments (11)
For some reason illustrious model is adding a lot of anime style and overburnt colours... Not good for realistic...
fair enough, these belly shapes mostly exist in digital art, so its not trained on any real images.
I'm not sure why, but it doesn't seem to work. It just never starts and I have to restart SD. Any idea what I could be doing wrong?
Not sure. Others seem to be using it fine, so probably something specific to your setup. It should work in any popular webui with noob_vpred base model
@throwawayjm I was using Illustrious, not noob. But even when I tried a noob model, it didn't seem to work. So I assume it's my setup.
Finally a Lora that can create pregnant woman with sagging belly.
It would be great it there would also be a version compatible with EPS noobAI and classic illustrious type models.
Planning on sticking with noob_vpred only. Once you've trained both a large eps and vpred model, you never go back to eps =P
Man I wish the pony version could do hyper pregnancy shapes as well as the illustratius one . Any plans to update pony? the Illustrious checkpoint is just so unstable still .
I don't plan on training on pony any more. noob_vpred as been easier to train for me, and I'd been waiting on a decent v_pred model for a long time. What makes illustrious unstable for you?
@throwawayjm Illustrious outputs vary wildly, while pony is more consistent. On the other hand Illustrious does a better job with poses, and following prompts.
Does this work for 1.0?
@Taco360 only noob_vpred. Havent tested it on IL 1.0 since its not a vpred model.