Try a strength between 0.6 and 1.0.
Why not create a merged checkpoint?🫤
painful_face_SDXL_epoch_15.safetensors