This workflow uses Mimic Motion to drive the generation of the pose of head. Background is replaced with a static image, ReActor is used to do a face swap and differential diffusion is used on a AnimateLCM pass to animate the background and clean up the singer. Live Portrait is then used to transfer the lips and/or eyes.ComfyUI VersionThis workflow was tested on ComfyUI v0.21 and should not have package conflicts when installing custom nodes from manager: <a target="_blank" rel="ugc" href="https://github.com/comfyanonymous/ComfyUI/releases/tag/v0.2.1">https://github.com/comfyanonymous/ComfyUI/releases/tag/v0.2.1</a>NodesRed nodes are models that need to be downloaded and selected in the workflow.Blue nodes are nodes that require user input.Recommended to use ComfyUI manager to install the following custom nodes. You will need to follow the instructions at the ReActor node github page to install insight face (<a target="_blank" rel="ugc" href="https://github.com/Gourieff/comfyui-reactor-node?tab=readme-ov-file#troubleshooting">https://github.com/Gourieff/comfyui-reactor-node?tab=readme-ov-file#troubleshooting</a>)<ul><li>ComfyUI's ControlNet Auxiliary Preprocessors</li><li>ComfyUI Frame Interpolation</li><li>AnimateDiff Evolved</li><li>ComfyUI-VideoHelperSuite</li><li>ReActor Node for ComfyUI</li><li>ComfyUI Essentials</li><li>KJNodes for ComfyUI</li><li>ComfyUI-MimicMotionWrapper</li><li>ComfyUI-LivePortraitKJ</li><li>Crystools</li></ul>ModelsManually downloaded and placed in folder<ul><li>AnimateLCM: <a target="_blank" rel="ugc" href="https://huggingface.co/wangfuyun/AnimateLCM">https://huggingface.co/wangfuyun/AnimateLCM</a> Put AnimateLCM_sd15_t2v.ckpt in "models/animatediff_models" and put AnimateLCM_sd15_t2v_lora.safetensors in "models/loras"</li><li>SD1.5 Checkpoint: you can use your favourite SD1.5 Checkpoint. I am using Realistic Vision.</li></ul>Download using ComfyUI Manager<ul><li>control_v11p_sd15_openpose.safetensors</li><li>control_v11f1p_sd15_depth_fp16.safetensors</li></ul>Automatically Downloaded<ul><li>MimicMotion</li><li>ReActor</li></ul>

Singing Avatar (Live Portrait, Mimic Motion, AnimateLCM)

Updated the workflow to get a more static background.

Files with SHA256: ece6ab42692854fb3731589d965089567bdcb1c7aad3a5be1286b3e4cfd63aed