Yes, a new toy. This is a simple workflow for generating new, unique faces. It uses SAM3 to mask specific features (like the nose or mouth) from a source image and then builds a completely different face around those parts. Good for creating character variations or unique identities.
Why did I need it? Because Pulid and Reactor weren't satisfying me in this regard. Face ID was creating unrealistic faces. Is this workflow more successful than those? You decide. Sometimes AI when trying to fit the mouth and nose into masked areas, a situation different from the reference ones may arise. IDK. Maybe someone will be inspired and develop it further in the future.
How it works: SAM3 Masking: Automatically selects facial features to keep as a reference.
Generation: it tries to create a new person using the unmasked parts.
Quick Guide:
Upload your source image.
Use the SAM3 prompts to choose which parts to keep.
If you like my work, you can buy me a coffee!
Description
Yes, a new toy. This is a simple workflow for generating new, unique faces. It uses SAM3 to mask specific features (like the nose or mouth) from a source image and then builds a completely different face around those parts. Good for creating character variations or unique identities.
Why did I need it? Because Pulid and Reactor weren't satisfying me in this regard. Face ID was creating unrealistic faces. Is this workflow more successful than those? You decide. Sometimes AI when trying to fit the mouth and nose into masked areas, a situation different from the reference ones may arise. IDK. Maybe someone will be inspired and develop it further in the future.
How it works: SAM3 Masking: Automatically selects facial features to keep as a reference.
Generation: it tries to create a new person using the unmasked parts.
Quick Guide:
Upload your source image.
Use the SAM3 prompts to choose which parts to keep.
If you like my work, you can buy me a coffee!
FAQ
Comments (11)
Excellent work- the future in t2i will combine ideas from controlnet, masking and direct modification of a partial generation to avoid the issue models have of generating the same faces and body shapes for a wide range of prompts.
The current problem is that the model knows an infinite variety of faces and bodies, but in t2i we lack fine control to get the model to exploit this knowledge. And I think the body problem is even worse than the face issue. The default is too much symmetry, and unnatural body perfection. But as I said the model knows all the variations- its just a matter of forcing it to use that information.
You've summarized it beautifully. Thank you. I was wondering if I should get three unique faces to push those boundaries. Two faces might not be enough.
What about merging human and animal faces, would that be possible? or is there already such a workflow?
Interesting, I haven't tried it, give it a try,
Great idea! )))
It would be really cool to create a similar workflow for the rest of the body (chest, stomach, and everything down to the feet) so that the character would be completely unique )))
NSFW-friendly, of course.
Do you have (or know of) a flow like this for Illustrious or NoobAI?
No, but only an edit model can do this.