RDBT [Anima]
Mid scale finetuned + guidance distilled.
I use it as a starting point to stack more style LoRAs.
See this page for update log. Random experiment, random quality. New version != better version. Feel free to leave feedback.
See this page for original LoRA (update more frequently, probably).
Sharing merges using this model is not allowed. Known model thieves: NukeA.I (closed-weight merged model on tensorart),
This model is based on
ym: AnimaYume (hf link) (civitai link). Has latest dataset.
b,p: Anima pretrained (hf link)
Usage:
Settings:
CFG scale: 1~4. This model has been guidance distilled. You can disable CFG (CFG 1) and run the model 2x faster. Cover images are without CFG for demonstration.
Steps: 24. Guidance distillation != step distillation. If you need low steps (8~12). Try to add 0.2~0.5x turbo lora.
Prompt
Always specify style, or use a style LoRA. Otherwise, you will get random/mixed style. This model does not provide overfitted default style. This is a feature, not a bug.
Quality tags:
It's recommended to omit all the quality tags, or just keep the "masterpiece", if you're not confident. Omitting those redundant tokens allows LLM to pay more attention on other words.
Quality tags have been reinforced during distillation. Thus they don't have noticeable effects. Same as negative tags. If you use cfg, there is no need to dump "score_1, blurry, worst quality, jpeg artifacts, extra arms,... x100 words" in your negative prompt. Those things have been distilled out.
Training settings:
~10k images finetuning -> guidance distillation
All captions are NL from Google Gemini.
Optimizer: adamw, constant lr 0.00002.
LoRA rank/alpha 24.
Guidance distillation target CFG 4.
Block 0-2 and adaln linear layers are skipped.
Description
FAQ
Comments (32)
im using anima model with 4-7 cfg sometime it can get good prompt adherence , does that doing the trick with this ckpt with 1-3 cfg ?
Just reuploaded the same ckpt again. For those who found and downloaded previous ckpt through notification system. You don't have to redownload. Cvitiai model api is still f***ked, previous assigned model ID was desynchronized and didn't get indexed, it disappeared across the site, didn't even show on my own profile page.
Would it be possible for you to adapt the NAG comfynode to support Anima? I remember this was done by a third party for ZIT because the official creator do not update model support of NAG (normalized attention guidance). NAG is allowing us to have negative conditioning even with turbo distilled models at CFG=1, while not really slowing down the model. Imo its even more effective for negative guidance than CFG in normal undistilled models.
In any case would be a great addition to the workflow.
https://github.com/BigStationW/ComfyUI-NAG this the most advanced fork of nag but still does not support anima :(
@brahianvalles It got now anima support!
0.25 version is an actual "RIP illustrious/noobai" the model has gotten too good.
Holy shit, man, you're a monster. Do you even sleep? I can't keep up with testing your models at the rate you release them!
this is actual black magic. how the fuck does this work? how the fuck CAN this work?
besides my bewildered amazement that we got a distilled finetuned model this soon for anima,
it definitely does not handle loras + text very well, text without loras mostly generates just fine like other models but introducing a lora totally destroys its coherency. otherwise, yeah this is pretty amazing it's up there with wai and animaika from what i've tested so far. and doing all that in only 12 steps ,very impressive.
Anima getting too good now
Can you run for president?
Nice update (v0.25), i tried the original one, Yume and WAI, but yours is better just by the low step requirement and i tried some style LoRas and they work well.
The ultimate Anima checkpoint so far. Have you ever thought of integrating the Cosmos-Predict2.5-2B base distilled extracted DMD2 LoRA into your great distillation work.
No. I prefer a clean model status, trained (optimized), no merge conflicts, for better stability.
Adding more LoRAs, that's up to you guys.
@reakaakasky actually I did notice that as I have tried using two DMD2 LoRA two your one and the cosmos one. And I did notice while it is good, especially regarding adding a bit more contrast. It also gives me a little bit more inconsistent results. So yeah I do agree with you on that.
Also the official anima team has released a turbo LORA however, it's not as stable as your one. I've noticed it does allow a little bit more diversity, but regarding stability and actually prompt adherence it's not as good as yours. Just wanted to say.
nice model, thanks
"Sharing merges using this model is not allowed"
But why?
You're not allowed to merge this checkpoint or LORAs with other models and share them I think. That's what it means as far as I'm aware.
@AnimaXx Yeah that's why i'm asking why author decided to not allow merges.
https://civitai.red/articles/26855/dev-story-stabilizer-and-rdbt
might be the answer
@ikekph5 Yeah that's explains, thanks.
For anyone unaware, this model can do photorealism, but it's not particularly great, since it isn't the focus. A lora could maybe make it work.
I keep getting photorealism when I don't want it 😭
Yeah, anima is still very bad with photorealism🫤
Something went downhill with V0.25, it is worse than V0.24
1. Listen to prompt less
2. Adds elements to image that were not in prompt
3. Is unstable
4. At times throws plasticy 3d/2.5d looks when it is clearly against prompt and art style
5. Consistently worse at generating texts in ratio 7:3 (+/-)
6. At times fails at anatomy (melted hand, melted feet)
here are examples/comparisons:
https://civitai.red/posts/28090228
https://civitai.red/posts/28093793
+ Can generate realistic looking people/photo-realism meaning some undesirable material got in and is littering the model. Anima was supposed to be 2D model, please don't do out of it 2.5D or 3D model, model for everything is model for nothing.
Thank you for your work, you made Anima usable model when it can work on CFG1, will cross my fingers and wait for V0.26 (perhaps p4 variant) Keep up the good work ❤️🙏 Muchas gracias
I'm writing an article about dmd2 anime model. It's really a shi*hole. I know lots of people wondering why I keep changing distillation settings drastically, wtf is this guy doing.
Short answer, I was trying to find a solution, but after 1 mouth, I now believe there is no such solution.
How to improve contrast in Forge NEO without increasing CFG above 1
I don't use Forge but try to look for cfg loras, they do exist, it might help x) I have one called "CFG Scale Boost"