TL;DR a style Lora to generate sharp looking cyber ladies (as a result of my adventure in using Stable Diffusion)Works with DPM++ 2M or Euler a (both with Karras), can be activated with "cyb3rlad1es", stack not too bad on PonyXL or SDXL with standard resolutions (1024x1024 or my usual 832x1216).Can be used at strength 1 if alone, but 0.8 is enough most of the timeFirst (and probably only) attempt at training a Lora.The long version of the story (links to lot of good resources for beginners)To try and better understand all the small stuff about Stable Diffusion, i first installed <a target="_blank" rel="ugc" href="https://github.com/AUTOMATIC1111/stable-diffusion-webui">Automatic1111</a> and started with the classical <a target="_blank" rel="ugc" href="https://civarchive.com/models/9409/or-anything-xl">AnythingXL</a> model to try and generate cool women in cyberpunk settings (because why not).Very fast, i found both <a target="_blank" rel="ugc" href="https://github.com/ahgsql/StyleSelectorXL">Style Selector</a> and <a target="_blank" rel="ugc" href="https://civarchive.com/models/312431?modelVersionId=350624">GhostXL</a> to trigger more cyberpunk in there (with Neon Punk style), together with <a target="_blank" rel="ugc" href="https://github.com/Bing-su/adetailer">Adetailer</a> (for face, <a target="_blank" rel="ugc" href="https://civarchive.com/models/150925/eyes-detection-adetailer">eyes</a> and <a target="_blank" rel="ugc" href="https://civarchive.com/models/142240/adetailer-after-detailer-lips-model">lips</a>).But since i liked some results from pure AnythingXL, i used the provided Checkpoint merger to do "AnyGhostXL" (0.5/0.5 merge of previously mentioned model).At this point, it was high time to start using Lora and two of them found their way in all my tries (because i saw them in pictures i liked):<ul><li><a target="_blank" rel="ugc" href="https://civarchive.com/models/122359/detail-tweaker-xl">Detail Tweaker XL</a> (at 1.5 strength)</li><li><a target="_blank" rel="ugc" href="https://civarchive.com/models/186617/doctor-diffusions-negative-xl-lora">Doctor Diffusion's Negative XL</a> (at -1 strength)</li></ul>Since they became present all the time, it was worth baking them in my own AnyGhostXL. Using the <a target="_blank" rel="ugc" href="https://github.com/hako-mikan/sd-webui-supermerger">SuperMerger</a>, both found their way in with these default strengths, creating "AnyGhostLora".Happy with this SDXL checkpoint, which i used together with a custom VAE (<a target="_blank" rel="ugc" href="https://civarchive.com/models/455138/sharpspectrumvaexl">SharpSpectrum</a>), i started looking for help on prompt and finally found <a target="_blank" rel="ugc" href="https://civarchive.com/models/257749/pony-diffusion-v6-xl">PonyXL</a>...Merging PonyXL with my own model was not giving good results, that's why i started using PonyXL as a refiner instead, switching at 0.7, and after a while, instead of using the base PonyXL, i switched to <a target="_blank" rel="ugc" href="https://civarchive.com/models/376450?modelVersionId=817261">DucHaiten-Pony</a>. And of course, i started mixing some <a target="_blank" rel="ugc" href="https://civarchive.com/models/341353/expressiveh-hentai-lora-style">ExpressiveH</a> in order to get nice expressions.But it still didn't feel good enough, that's when <a target="_blank" rel="ugc" href="https://civarchive.com/models/360492?modelVersionId=402859">Kuro CAT minimalistic</a> style got into play to really get the style I imagined.Together with Textual Inversions (<a target="_blank" rel="ugc" href="https://civarchive.com/models/118418">negativeXL</a> and <a target="_blank" rel="ugc" href="https://civarchive.com/models/119032?modelVersionId=134424">unaestheticXL</a>), it was time to generate "en masse".Using <a target="_blank" rel="ugc" href="https://github.com/adieyal/sd-dynamic-prompts">Dynamic Prompts</a>, i started getting a good lot of cool ladies and decided in was the right moment to switch out of my custom checkpoint AnyGhostLora (based on SDXL) to PonyXL based model for generation (and avoid pushing this merged stuff here to post pictures).I have included the wildcards I used and here is the prompt (without the PonyXL stuff).<pre><code>1girl, looking at viewer, __body__, __viewpoint__, __subject__, __eyes__, (__hair__), __cut__, {1-2$$__modifiers__}, {1-2$$__accessory__}, (__legwear__), __expression__, (__lips__:1.1), Fisheye lens, (Bokeh) &lt;lora:Minimalistic_Style_Pony:0.8&gt; BREAK __location__, cyberpunk style, __lighting__</code></pre>After generating a good close up and with <a target="_blank" rel="ugc" href="https://github.com/lllyasviel/ControlNet">ControlNet</a> together with <a target="_blank" rel="ugc" href="https://huggingface.co/xinsir/controlnet-openpose-sdxl-1.0">OpenPose</a>, i generated a bunch of ladies for Lora training.Using <a target="_blank" rel="ugc" href="https://github.com/bmaltais/kohya_ss">Kohya</a>, and PonyXL as base model, you have the result here :DTo tag the dataset (~80 pictures), i could have extracted using <a target="_blank" rel="ugc" href="https://python-pillow.org/">pillow</a> the prompts used, but to get a more generic bunch of tags, i preferred using <a target="_blank" rel="ugc" href="https://huggingface.co/SmilingWolf/wd-v1-4-vit-tagger-v2">WD14</a>.That's all folks, thanks for reading!<s>NB: At one point, maybe i'll post AnyGhostLora too since it still work well with this lora ^^;</s><a rel="ugc" href="https://civarchive.com/models/838855/anyghostlora">AnyGhostLora</a> is on Civitai too now :D

Files with SHA256: 4dfea3e6d27009eda667f41a25508751dd656defcfa0ca04a6bf0f6cc607da78