I have now created a model. You can try out how it all works with my checkpoint model, you can use with lora models and embeddings.

and you could also try using clip skip 1-2 to see what suits you.

So, test something out and have fun!