LoRa Diffusers format may not be supported by ComfyUI! (At least I couldn't run it)
Trying to train LoRa with https://github.com/a-r-r-o-w/finetrainers
The following keywords are used in the prompt:
breast growth, woman with growing breasts.
Example of a prompt:
breast growth, Anime-style digital animation of a cute, busty woman with growing breasts and short brown hair, green eyes, and large wings. She wears a frilly white and pink dress with a star pendant, holding a wand. Background is pastel pink with sparkles.Code to run LoRa (example taken from finetrainers)
import torch
from diffusers import HunyuanVideoPipeline
import torch
from diffusers import HunyuanVideoPipeline, HunyuanVideoTransformer3DModel
from diffusers.utils import export_to_video
model_id = "hunyuanvideo-community/HunyuanVideo"
transformer = HunyuanVideoTransformer3DModel.from_pretrained(
model_id, subfolder="transformer", torch_dtype=torch.bfloat16
)
pipe = HunyuanVideoPipeline.from_pretrained(model_id, transformer=transformer, torch_dtype=torch.float16)
pipe.load_lora_weights("my-awesome-name/my-awesome-lora", adapter_name="hunyuanvideo-lora")
pipe.set_adapters(["hunyuanvideo-lora"], [0.6])
pipe.vae.enable_tiling()
pipe.to("cuda")
output = pipe(
prompt="A cat walks on the grass, realistic",
height=320,
width=512,
num_frames=61,
num_inference_steps=30,
).frames[0]
export_to_video(output, "output.mp4", fps=15)The training was conducted on 220 videos 33x512x512 (33 frames and 512x512 video resolution)
Most of the videos were generated by AI and only 27 videos were made using Framer interpolation
Description
FAQ
Comments (4)
the new sims update is crazy
Awesome! Thanks a lot for making this. Will be fun to mess around with. ๐
Dammit!
It doesn't seem to work for me for some damn reason...
Yeah, I think this model needs a retrain. The trainer you used gives me an error where it can't seem to read the block weights