WAN2.1 | FusionX | LLM | SDXL/FLUX/PONY | UpscalingThe SDXL (also PONY files work without issues) version uses any SDXL/PONY model for the initial image generation and refining.The FLUX version uses a separate SDXL model for the refinement before it's sent to the WAN part.Still quite unhappy with (most) WAN T2V workflows, playing around with various ways to create a more fun way of doing Text to WAN Video.This workflow would take a rather simple/short base prompt, feed it to a LLM for an enhanced/extended prompt to generate a set of images and the best or nicest to be selected.That image will be upscaled/refined and handed over to LTXV image captioner for a extended image prompt (you can also override this, and provide a manual prompt).<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b737e847-0577-45bb-9929-942f1d0874e8/width=525/b737e847-0577-45bb-9929-942f1d0874e8.jpeg" />Personally, I prefer to keep the LLM prompt enhancer on a fixed seed. depending on the LLM model used, it can sometimes generate a "to detailed" prompt for SDXL to process. In such cases, change the seed manually.Most SDXL will try to follow the enhanced prompt quite well (both SFW and NSFW).<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/0cbcaf8e-de31-41bc-b059-17315d34cce7/width=525/0cbcaf8e-de31-41bc-b059-17315d34cce7.jpeg" />That image will be upscaled/refined and handed over to LTXV image captioner for a extended image prompt (you can also override this, and provide a manual prompt).<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/f6ecd5f4-58d6-42b7-97a6-b80e24801437/width=525/f6ecd5f4-58d6-42b7-97a6-b80e24801437.jpeg" />By default it allows for 3 WAN Lora's to be loaded (followed by the Fusion X Lora).Credits: The WAN generation is mainly taken from <a target="_blank" rel="ugc" href="https://civarchive.com/models/1309065/wan-21-image-to-video-with-caption-and-postprocessing?modelVersionId=1998473">https://civarchive.com/models/1309065/wan-21-image-to-video-with-caption-and-postprocessing?modelVersionId=1998473</a> (from user tremolo28) with some modifications.Hardware used for testing and generating the posted vids:RTX 4070TI Super 16G vRAM / 80G RAM

WAN2.1 | FusionX | LLM | SDXL or FLUX | Upscaling

Flux version uses any Flux diffusion model, followed by a SDXL refinement step.

Files with SHA256: 1c18cbdf20f0b775ef601be53b172871ba2909aa0ce0bcbd147c4ef3ffbb8b2d