Speaking of this lora, it is also very strange. I have been training in the same way, and other clothing works normally. I trained this lora three times in a row, and the learning rate dropped from 3E-4 to the final 1E- After 4, I found that the final model was still over-fitting. I felt that although the parameters were dead, it might still need a little luck.

This should be the most satisfying version, I hope you like it.

Recommended weight is 0.9