Wang on Z
840 steps
1e-4 learning rate dropped from 2e-4 of the first LORA training and Network Rank DIM increased from 64 to 128 with a standard Alpha of 32 as usual.