V2: Massively overhauled the dataset, adding around 10k unique pairs of various types of edit pairs. Also included a few more experimental datasets like line art reference and restyling. Nearly every image is captioned with natural language now, making the model much easier to use overall. Trained with mixed resolutions of 512, 768, 1024, mitigating the issues experienced with the beta version when trying to edit with higher res images.

Beta: This first version of V2 was exclusively trained at a resolution of 512 and even after a small amount of testing I could tell there are some heavy limitations at higher resolutions, like detail preservation and unwarranted edits. I will probably continue the training run with mixed resolutions and hope that those issues can be mitigated.

Usage: First you will need to install the ComfyUI-Cosmos-Reference custom node and then use the sample workflow. For prompting use mostly natural language and supplement with tags if something doesn't work.

If you have any suggestions for reference control or edit tasks, just leave them in the comments or dm me. As always, data is the main factor to making a better model, so if anyone has any high quality datasets they would like to share, I'd happily include them in training.

V1: First of all, I got to mention the original LoRA that this was based on, here. Similarly to that model, it aims to bring editing concepts natively into Anima via difference tagging. Currently the majority of the data is for removing clothes, but I also reversed the data so the model also understands how to put clothes on as well. The train was done with just over 5k unique pairs of data meaning over 10k pairs after reversed.