CharTurner
Edit: controlNet works great with this. Charturner keeps the outfit consistent, controlNet openPose keeps the turns under control.
Three versions, scroll down to pick the right one for you.
If you're unsure of what version you are running, it's probably 1.5, as it is more popular, but 2.1 is newer and gaining ground fast.
Version 2, for 2.0 and 2.1 models
Version 2, for 1.5 models
Version 1, for 1.5 models
BONUS: Experimental LORA released
used at your own risk. :D (mixes well tho)
Hey there! I'm a working artist, and I loathe doing character turnarounds, I find it the least fun part of character design. I've been working on an embedding that helps with this process, and, though it's not where I want it to be, I was encouraged to release it under the MVP principle.
I'm also working on a few more character embeddings, including a head turn around and an expression sheet. They're still way too raw to release tho.
Is there some type of embedding that would be useful for you? Let me know, i'm having fun making tools to fix all the stuff I hate doing by hand.
v1 is still a little bit... fiddly.
Sampler: I use DPM++ 2m Karras or DDIM most often.
Highres. fix ON for best results
landscape orientation will get you more 'turns'; square images tend toward just front and back.
I like https://civarchive.com/models/2540/elldreths-stolendreams-mix to make characters in.
I use an embedding trained on my own art (smoose) that I will release if people want it? But it's an aesthetic thing, just my own vibe.
I didn't really test this in any of the waifu/NAI type models, as I don't usually use them. Looks like it works but it probably has its own special dance.
Things I'm working on for v2: EDIT: V2 out, see below! (also v2 2.1)
It fights you on style sometimes. I'm adding more various types of art styles to the dataset to combat this. - V2 has much better styles
Open front coats and such tend to be open 'back' on the back view. Adding more types of clothing to the dataset to combat this. - Still has this problem
Tends toward white and 'fit' characters, which isn't useful. Adding more diversity in body and skin tone to the dataset to combat this. - v2 Much more body and racial diversity added to the set, easier to get different results.
Helps create multiple full body views of a character. The intention is to get at least a front and back, and ideally, a front, 3/4, profile, 1/4 and back versions, in the same outfit.
Description
2.1 and LoRa versions coming soon.
Prompt hints: format something like this: "A character turnaround of a (X) wearing (Y). " In some of the prompts the token is spelled differently: due to some technical issues with xformers, I trained this badboy about 40 times, and some of the examples are from those trainings. All the same dataset, I promise. Just change any weird token names to CharTurnerV2 if you use them.
Token - "CharTurnerV2" place at the front for stronger effect, place at the end for a weaker effect. Token weighting works too
Add:
"Multiple views of the same character in the same outfit"
Add original CharTurner to mix back in some anime/turns
Add charTurner Lora (uploading soon) on top (at very low strength, like .3) to really force the turn. Will affect style.
Next Version: (after the v2 lora and 2.1 versions): Looking for more variety for the data set! Post a review or comment with your best turn around (especially if it was a hard one to get it to do!) and I will use it in the V3 dataset.
FAQ
Comments (38)
Buenísimo trabajo. Can't wait till I get home to try it out.
Great!! Curious to know about LORA version . What kind advantage using LORA than TI version ? Is it better ?
Not better, just different? I think Lora are a little heavy handed (for instance, the Lora version has to be used at .2 - .4 weighting, or it takes over entirely.). I'm new to Lora, so i probably bollixed up some setting, hope to have it worked out and behaving soon.
@mousewrites thanks for information . would you mind to let me know what model you`ve used to produce those examples ?
@juvesatriani StollenDreams, Dreamshaper, RealisticVision, 1.5 pruned (which is what it was trained in). Maybe a few others here and there but those are my main ones.
Oh and Protogen58scifi
Looks like an incredibly good basis to start textual inversion training of the character.
Is it possible to make it generate whole recommended set (25 different poses) in one go?
Maybe take a 25 pose shot of a different character and try img2imge over it? With this version, it's probably not doable to prompt for 25 specificic poses.
I'm absolutely floored at how good this looks. Can I ask how many examples of your own training data you used and how long it took to train? I've been trying to do this for a facial expression sheet for a few days and can't seem to get anything but garbage output.
22 images, 660 steps, about an hour to train. BUT i've been working for WEEKS, training over and over, trying to find the right balance of dataset and settings. There's a bug in auto1111 training with xformers that might be screwing you, check this out (link should go to workaround solution that fixed it for me) https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/7264#issuecomment-1418206085
Also, I wrote a thing for expression sheets, because I had no luck with an embed either, really. This method works tho https://www.reddit.com/r/StableDiffusion/comments/103rk2k/use_script_xy_prompt_to_create_expression_sheets/?utm_source=share&utm_medium=web2x&context=3
@mousewrites You are a lifesaver. Thank you so much.
Is it possible to put dummies in poses that you need and use img2img to imperonise them with your prompt on medium \ high denoise? Will it work? And I ask not only T poses but a bit more complex ones.
Yup, that's one way to do it. LIke, get a set of dummies that are in roughly the right spots, put your character over ONE of them, mask that one, and use an inpainting model to img2img the rest of them.
Ok, cool. Thanks for the very usefull work!
What model are you using for those results ?
various, including base 1.5 pruned, stollenDreams, Deliberate, Dreamshaper, Protogen58, RealsticVision.
Thanks! btw, I'm not aware of stollenDreams model, do you have a link ?
I can't spell. XD https://civitai.com/models/2540/elldreths-stolendreams-mix
Hi, I see that u mentioned landscape, what are the ideal dimensions that you suggest? Also how many steps on average?
anything wider than it is tall, i don't have a ideal dimension. All the source images are square, of course, but the many turn ones have a lot of 'headroom', which the ai mostly doesn't like. So, i've tried everything from 4:3 to 16:9 and they all work. (there's an extension that adds ratio buttons to automatic1111 now, they are very useful). So, 512 for the height, something larger for the width. 768 works well just cuz it's tidy. XD
Steps depend on your sampler. I do a lot of ddim at 20-30 steps.
Very nice work!
is it possible to use this as a mirror-image generator?
you can try! :D I didn't teach it to do that specifically but you can probably get it to happen.
make a safetensors version plz
I don't think there's a safetensor version of textual embeddings, but if I can find out how to do that I will. :D
Checked with the Civatai people; no way currently to have a safetensors embed. There IS a lora version, though it's not as good yet.
@mousewrites o ok
Does anyone know how to put this in the nmkd stable diffusion gui?
I don't think that gui takes textual inverserion embeds, sadly. I will ask around, but afaik, it doesn't.
Do you know when you'll release the 2.1 version of your amazing TI?
I have it ready to go, just trying to get a few more demo shots, so probably today?
I wonder if this can be used with controlnet's pose control.
Ooo, I dunno, that'd be rad if so
Update: yes, yes it can. Control net will pick up multiple people, and using charturner means they all get the same outfit. :D
Can we have a safetensors version model of this?
Nope. It's not a model, and there's no safetensors verison of embeds (if they make one, I will use it, but it doesn't currently exist). This goes on top of your model.
Details
Files
charturnerv2.pt
Mirrors
charturnerv2.pt
charturnerv2.pt
3036_8387_charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
3036_charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
pytorch_lora_weights.bin
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
charturnerv2.pt
CharTurnerV2.pt
charturnerv2.pt
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.















