Use Lora Strength between 0.65 and 0.85

Use Adetailer for better faces