My approach: I generate everything in "Fast" mode first to quickly iterate and find the best results, then I selectively upscale only the videos worth keeping by reusing the same seed.

Generation Modalities

• 📝➡️🎥 Text-to-Video Create completely new videos from scratch using text prompts.

• 🖼️➡️🎥 Image-to-Video Animate static reference images using text prompts.

• 🖼️🖼️➡️🎥 First-Last-Frame-to-Video Generates a coherent video sequence that bridges a defined starting and ending image.

• 🎥➡️🎥 Video-to-Video Generates synchronized audio and speech driven by video visuals. Offers options to pass through or entirely regenerate the source video.

Audio Input Settings

• 🔇 No Audio Input No external audio file used. The AI generates new audio based on your text prompt.

• 🔊 Audio Input Upload an existing voice or music file to drive the animation and lip-sync.

🚀 VRAM Optimization & Long Videos

⚙️ Chunking Settings for Longer Videos

Adjust ffn_chunks based on your video length (at 24fps):

• 10 seconds (240 frames): ffn_chunks=1-2

• 15 seconds (360 frames): ffn_chunks=2-4

• 20 seconds (480 frames): ffn_chunks=4-6

• 25 seconds (600 frames): ffn_chunks=8-10

• 33 seconds (800 frames): ffn_chunks=12-16

If you encounter OOM (Out of Memory) errors:

• Increase ffn_chunks value

• Reduce resolution slightly