ERNIE Image
I used the same dataset as the Flux lora. I trained this locally on my GPU using Ostris AI toolkit.
FLUX
Lightning lora trained on Flux.1 D
Similar dataset as SD1.5. I did not resize images to 512x512. They are their original sizes from web searches. Updated captioning using Florence. Reviewed and manually edited the captions. Lora was trained on fal.ai 1000 steps at 4e-4 training rate. This was mostly an experiment to see how training a flux lora would work.
Use lora strength of 0.5 to 0.7. But feel free to experiment.
There is no specific trigger word. But it's helpful to include "Lightning from Final Fantasy" in the prompt.
SD 1.5
Use weight of around 0.67 for best results.
LoRA trained on SD 1.5.
Images trained on game official art and ingame screenshots. Note the "cat ears" in the negative prompt. I only had one training image where Claire had cat ears, yet it spontaneously shows up more often than not in the generated images. Might be a positive for some people. It is necessary to add "pink hair" to the prompt to get the Lightning look.
Images uploaded were generated using GalaxyTimeMachine Photo model. However, also works well with DreamShaper and chilloutmix.
Description
Trained same image dataset on ERNIE.
FAQ
Comments (7)
what settings you use for ERNIE Image?
For these I'm using Erni Image Turbo. 8 steps, 1.0 cfg, sampler is euler, scheduler simple. All the info is in the image so you can copy the nodes and put in your own comfy.
@carbonbased My bad im meant using Ostris AI toolkit.
@karunodragon409 mostly defaults for the Ernie preset on AI toolkit.
Under Quantization, for transfomer, I use 'None'.
Under Training, I have "Cache Text Embeddings" enabled
Under Advanced, I have "Do Differential Guidance" enabled
Hello. i have question.
i wanna make lightning return ver outfit lightning farron.
then, Which one i use? SD ver or Ernie Version?
i use VXP model now.
The loras arent't trained to any specific outfit. Just the general promo images and some ingame screenshots with her default outfit. So you'll probably only get that style of outfit normally. The ERNIE one has the most flexibility in my experience, so if you try describing the outfit in the prompt you might get what you want.
@carbonbased thank you!