MiniMax H3 Unified · Nova.5 — Lip-sync, Scene Prompts and Saved-run Edits/Backups

Workflow: MMH3_Unified.json

Workflow version: Nova.5

Guide updated: 14 November 2026

Create a performance video from an existing recording, or generate video and audio from text and images. Both paths use the same render loop, with a prompt for each scene, an accumulated preview, and saved runs you can continue, correct one part at a time, or restore from a backup.

The optional reference-video analysis finds scene boundaries and describes the movement between them. You can review and edit those prompts directly before rendering, or enter all timings and prompts manually. Optional YuE2 and MiniMax Music 3 groups can create a soundtrack; video upscaling, lyric extraction and animated captions are also included.

This guide uses lip-sync with a character image and an existing recording as its main example. Native H3 is an alternative path. Model names and numeric settings below are examples to adapt to your files and hardware.

Recommended first test: Use a short excerpt, leave music generation, upscaling and captions off, and generate one part per queue. Keep Disk and Keep in output enabled so you can continue from the result.

What is new in Nova.5

• Update one saved part in place: choose Update selected run, set a one-based Restart part, and regenerate exactly that part while keeping the saved beginning and ending. The run folder stays selected for your next correction. Requires Disk + Keep in output.

• Backups inside the run: each successful update keeps the previous version, including its media, prompts, seeds and saved inputs. Interrupted or failed updates leave the current version intact.

• Preview and restore: Load Video Run can load an earlier backup or make it current with Restore selected backup, without rendering. Restore also backs up the version it replaces.

• Saved prompt corrections: Part Prompt Editor reloads the updated text after a successful correction. Restoring a backup reloads its prompts and clears pending edits with Apply off.

• Prompt navigation: Part Prompt Editor now matches Prompt Review, with a dropdown in the selected Eclipse theme and ◀ / ▶ buttons to move between parts without losing edits.

• One operation for one-part corrections: the separate-folder Replace selected part only choice has been removed. Older saved workflows using it now select Update selected run. Resume saved run still creates a new folder when continuing or regenerating an ending.

Keep Parts per queue = 1 for step-by-step New/Resume work. Update always renders exactly one part, regardless of this limit.

See Replace one part and keep the saved ending and Preview or restore an earlier version for the controls.

Included from Nova.4

• Separate opening warmup: give the first lip-sync part a hidden lead-in, such as one second, independently of later reset warmup. The final video retains the complete soundtrack and its timing.

• More transition coverage: Scene Detector now also checks persistent appearance changes across short blends. Review its boundaries; fast pose changes and edits against similar backgrounds can still be missed.

• Multiple lip-sync images: each image interval receives its own scene prompt. Supplied transition times stay in order, and images without a time are spaced evenly through the remaining audio.

• Native H3 FMF mode: use two images as first → middle → first. Keep measured/manual cuts or use three equal sections when none are supplied; a single description can cover all three.

• One image, multiple cuts: use manual cut times and separate prompts while reusing one reference. With no cuts and an empty next-part list, a single-image FL2VA scene uses generated continuity at extra render splits.

• Updated scene analysis: Frames/Grid input, editable task instructions, and clearer framing, movement and appearance rules. Scene Description (T2V) still analyzes the source video or images; T2V means the generator has no separate appearance reference.

• Optional video upscale: process the assembled lip-sync or native H3 result before captions and saving. The group uses named variables and can be muted as a whole; downstream groups automatically fall back to the original video and dimensions.

• Stop a stuck LM: the ■ button at the end of Smart LM's Mode bar stops the current workflow and force-stops its managed Ollama/Docker backend. The collapsed bar stays on one row.

Restart ComfyUI after updating the Nova packs, then refresh the browser. Rerun scene analysis for the new descriptions and use New run for changed timing, image assignment or warmup. Resume and Update keep the plan saved with their run.

Included from Nova.3

• Correct patch order: H3 patches → Sparse → Diff-Aid. Diff-Aid now builds on Sparse without losing its text-conditioning adjustment.

• Individual patch switches: enable or bypass each patch directly. Turning a switch off keeps the model flowing through the remaining patches.

• Music switches in START HERE: activate YuE2 or MiniMax Music 3 from Optional sources + analysis, without navigating to the music group.

• On-canvas explanations: Markdown notes explain compatible combinations and the controls. Named Set/Get routing keeps connections inside the patch groups.

See Optional H3 patches and Sparse Attention for the patch choices.

Included from Nova.2

• Prompt Review shows the opening prompt and all later scene prompts together. Leave Pause off for automatic passthrough, or pause before rendering, edit in place and continue the same run. The dropdown and previous/next arrows follow the Eclipse Nova theme.

• Part Prompt Editor lets you correct the combined prompt for an individual render part of a saved run, then apply it on Resume or Update.

• SmartLLM scene input accepts the scene sampler's disk frames wherever the selected task supports images. Together analyzes the ordered selection as one scene; ordinary image and MiniMax H3 tasks can feed the collector through Scene JSON.

• Task and mode controls distinguish motion transfer from full scene descriptions and keep Thinking optional and off by default. Current SmartLLM uses one editable instruction set per task.

Choose what you want to make

• Lip-sync: animate a reference image to an existing song, dialogue or other vocal recording. Use manual scene prompts or copy the editing rhythm and gestures from a reference video.

• Native H3: generate from text, a starting image, first/last images, different images for different scenes, or visual references. Supply a soundtrack or let H3 generate the sound.

• Resume: continue an unfinished saved run without generating the completed parts again.

• Regenerate an ending: use Resume to keep the beginning and generate a new version from a chosen part onward.

• Update: correct one already saved part, keep the other parts, and back up the previous version in the same folder.

• Load: reuse a saved run for upscaling, captions or another export without sampling the video again.

The workflow is organized into groups and subgraphs. Open a subgraph when you need its additional controls; most everyday changes are on the main canvas. The groups share their values through Get/Set routing.

Install and open the workflow

Use a ComfyUI build with native MiniMax H3 support. The working setup for this guide uses ComfyUI 0.42.1. YuE2 and MiniMax Music 3 support is needed when enabling their optional groups.

Install or update these Nova packs, including their dependencies in the Python environment used by ComfyUI:

• ComfyUI Eclipse Nova — input panels, scene analysis, prompt review/editing, planning, the render loop, saved runs, previews and captions.

• ComfyUI Smart Model Loader Nova — H3/music loaders, loader presets, LoRA presets and Download Manager.

• ComfyUI SmartLLM Nova — reference-frame descriptions and optional music/lyric prompting.

The H3 patch and Diff-Aid nodes come from ComfyUI-sol-attn. Block Sparse Attention is a built-in ComfyUI node. Vocal separation uses Audio Separation Nodes. Install those packs to have every included node available; their processing groups can stay muted for the first test.

Restart the ComfyUI backend after installing or updating Python nodes, then refresh the browser and open the workflow. The render and analysis loops are provided by Eclipse Nova; Easy-Use is not required.

Replace the example image, video and audio selections with your own files. An unavailable example saved-run selection is harmless in New run mode. Resume, Update and Load require a run that exists on your computer.

Models, presets and downloads

Switch the generation path and both presets

In START HERE, choose Lip-sync or Native H3. Then select the matching setup in both Smart Model Loader and LoRA Stack:

• Lip-sync: MiniMaxH3_LipSync in the loader and the separate LoRA preset list.

• Native H3: MiniMaxH3_TFL2VA in both lists.

These presets belong to Smart Model Loader Nova. Use its current template files, or save your own versions after choosing your local models. Loading the workflow preserves its embedded settings, but your local preset list is managed separately.

Check when switching: The generation-path buttons do not automatically load model or LoRA presets. Check all three selections before queueing. The analysis task and appearance option are separate choices too.

H3 files used by this setup

Both paths need an H3 diffusion model, the MiniMax H3 Qwen3-VL 32B text encoder, the H3 video VAE and the H3 audio VAE.

• Lip-sync example model: minimax_h3_fl2va_pruned_int8_convrot.safetensors, available from Comfy-Org/MiniMax-H3. Store it in ComfyUI/models/diffusion_models/, optionally in a minimax subfolder.

• Optional community native model: minimax/h3ErosMax_beta7_3329966.safetensors. Its exact Civitai AIR is:

  urn:air:minimaxh3:diffusionmodel:civitai:2851079@3429412+3329966

  H3 ErosMax — example model version

• H3 text encoder: the workflow calls its local file qwen3-vl-32b-minimax-h3-int8-convrot.safetensors. The official INT8 ConvRot file uses underscores and has the same SHA-256. Download it into ComfyUI/models/text_encoders/ and select its actual filename in the loader.

• Video VAE: minimax_h3_video_vae_fp16.safetensors.

• Audio VAE: minimax_h3_audio_vae_fp32.safetensors.

Both VAEs are in the H3 VAE folder; place them in ComfyUI/models/vae/.

For native endpoint modes, choose an FL2VA-compatible model. For reference_images, choose a Ref2VA-compatible model; the official H3 repository also provides minimax_h3_ref2va_pruned_int8_convrot.safetensors. Check the model author's supported modes when using a community model.

Two different language-model roles: H3's 32B encoder is part of video generation. The smaller vision model in Smart LM describes reference frames. Installing one does not replace the other.

Use a saved AIR in Download Manager

An AIR identifies the selected Civitai resource. The saved AIRs here include the version and exact file, so you can find the intended download even when the workflow's local filename is missing.

1. In Smart Model Loader, open the missing resource's Source / integrity controls. For a LoRA, use the row's i button.

2. Keep the saved CivitAI source and AIR, or paste an AIR into the source field.

3. Click Open in Download Manager. Review the listed file and its destination: diffusion_models, text_encoders, vae or loras, as appropriate.

4. Select the file and click Add Selected to Queue.

5. Open Queue, select the ready job and click Start Selected.

6. After completion, the originating field receives the downloaded filename and verified source information. Save the workflow and use Save… if you want to update your preset too.

Keep the workflow open while downloading if you want automatic assignment to the original field. If you reload the browser, select the completed file manually afterward. Opening a workflow or the download panel does not start downloads automatically.

For files without a saved AIR, choose Hugging Face, enter the linked repository or file URL, and follow the same queue/start steps. Model access may require your provider account; configure it through the pack's supported settings. See the illustrated Download Manager guide.

LoRAs and sampling

The lip-sync example uses Euler / beta, CFG 1 and 8 steps, with minimax_h3_turbo_v4_step600_pruned_comfyui.safetensors enabled at strength 1. Download it from the publisher's file page.

An alternative row is minimax_h3_PDMD_DMAD_4step_r256_add_fro1_turbo_lora.safetensors, from Darksidewalker's MiniMaxH3 repository. That repository requires accepting its access conditions. Leave this row disabled for the example above; when choosing a different accelerator, use its matching sampling settings and save that combination as your own loader/LoRA presets.

Optional additions for a native H3 setup include:

• MysticXXX_MMH3-V5.safetensors — AIR urn:air:minimaxh3:lora:civitai:2856467@3416478+3309543.

• Minimax H3 Cinematic Look.safetensors — AIR urn:air:minimaxh3:lora:civitai:2908686@3289775+3174203.

• minimax_h3_fl2v_turbo_8step_v1.0_comfyui_bf16.safetensors — available in the official H3 LoRA folder.

Place LoRAs in ComfyUI/models/loras/ and select the actual local filenames. Disabled rows do not need their files downloaded for execution. Check the enabled rows, sampler, scheduler and step count whenever you change presets; these settings depend on the selected checkpoint and LoRAs.

Optional H3 patches and Sparse Attention

The optional groups apply patches in this order: LoRA → H3 patches → Sparse → Diff-Aid → sampler. This shared model path serves both lip-sync and native H3.

Use the Patch switches · OFF = bypass bar in each group to control its individual nodes. OFF skips that patch and passes the model onward. For patches with their own enabled option, keep it on when controlling them through the fast switch.

PatchWhen to use itScheduled Sol AttentionAn alternative to built-in Sparse. Leave it off while Sparse is enabled; choose one attention patch.Fused ModulationA separate optimization that can remain enabled with either attention patch.Chunk Feed-ForwardCan reduce peak VRAM use at a speed cost. It can work alongside Sparse or Scheduled Sol.Native Sparse AttentionApplies the built-in sparse method. Choose a method suited to your checkpoint: sol-attn uses a training-free threshold; sla and vsa are intended for matching trained weights.Diff-Aid Text ModulationAn optional text-conditioning adjustment, not a speed patch. It runs after Sparse so Sparse cannot overwrite it.

To omit a whole group, mute it. Named Set/Get routing falls back to the preceding available model without cross-group wires. Re-enable the whole group before using its individual switches again. The Markdown notes beside the nodes summarize these choices; enable optional patches one at a time when comparing their effect on your lip-sync result.

Models needed only for optional features

Reference analysis / automatic prompting: choose a supported vision-language model in Smart LM. One local ComfyUI example is qwen3-vl-8b-heretic-1.3.0-int8-convrot.safetensors. Its recorded file source is:

urn:air:qwen2:text_encoders:civitai:2955374@3347601+3234858

Use this AIR in the standalone Download Manager, download to models/text_encoders, then refresh and select the model in Smart LM. You can choose another supported vision model for scene analysis, including a configured Ollama model. Text-only lyric prompting does not require vision. Backend setup is covered in the SmartLLM README.

Lip-sync activity encoder: the included audio-encoder branch selects wav2vec2_large_english_fp16.safetensors. Put it in models/audio_encoders/; it is available in Comfy-Org's audio-encoder files. Native H3 generation does not use this separate encoder.

YuE2: select yue2_3b_int8_convrot.safetensors from Comfy-Org/YuE2 checkpoints, under models/checkpoints/. Its loader uses the checkpoint's included text encoder and VAE.

MiniMax Music 3: the saved local names are minimax/minimaxMusic_v30_fp32.safetensors, qwen3-8b-minimax-music-v30-3107729-bf16.safetensors and minimax_music3_dav.safetensors. For a setup from Comfy-Org/MiniMax-Music-3, select minimax_music3_dit_fp32.safetensors, minimax_music3_text_encoder_pruned_bf16.safetensors and minimax_music3_dav.safetensors in the corresponding diffusion-model, text-encoder and VAE folders. Select the downloaded files in the Music 3 loader rather than leaving unavailable example names.

Whisper and optional Qwen timing setup are described in the captions section below. Leave unused groups muted; their models are not needed for a basic video run.

Find the main controls

• START HERE · run mode + opt inputs: choose the generation path. Optional sources + analysis controls Images, Audio override, Reference video, Live analysis, LS vocal isolation, YuE2 and MiniMax Music 3.

• Shared H3 loader + separate LoRA presets: choose the model setup for that path.

• Optional H3 patches / Optional Sparse Attention / Optional Diff-Aid: use the individual patch switches and the adjacent Markdown notes; Diff-Aid is applied last.

• Canvas + output folder · 24 FPS: choose aspect ratio, resolution and delivery folder. Keep H3 at 24 FPS.

• Optional images / Reference video / Optional audio override: load your source material and set any excerpt.

• Global prompts / Manual cut times + first / next part prompts: write the overall direction and individual scenes.

• Part source / MMH3 Reference Analysis: choose live or manual scene inputs and inspect analysis reports.

• First + next scene prompts · review: use Prompt Review to display the selected opening and later prompts, optionally pause and edit before generation.

• Run operation + saved-run selection: choose New, Resume, Update or Load, storage, and the saved run. Load Video Run also selects backups for preview or restore.

• Part Prompt Editor: read the selected saved run's prompts and correct individual render parts before resuming or replacing them.

• Shared H3 render loop: set the render seed, part limit and native image mode; watch the assembled preview.

• Optional upscale · enable group to use: upscale the assembled result before captions. Mute the whole group to restore the original video and dimensions automatically.

• Shared result + save video: export the first active result: captioned video, upscaled video, or the original assembled video.

First run: lip-sync to your recording

1. Choose Lip-sync and load the matching loader and LoRA presets.

2. Turn Images on and load one image in Load Image Timeline. Choose the canvas size and check the crop.

3. Turn Audio override on and select your recording in Load Audio. For this first test, turn Reference video, Live analysis, YuE2 and MiniMax Music 3 off in START HERE.

4. Choose a short excerpt using Shared clip start (seconds) and the duration on H3 clip (shared caption trim). Duration 0 keeps the remaining recording, so enter a short duration deliberately.

5. Clear the example manual cut times and first/next prompts if you want one simple performance. Keep a short global direction such as: “The subject sings to the supplied audio with natural head movement and expressive eyes.”

6. Choose New run, Disk, and Keep in output. Set Parts per queue to 1 in Video loop · saved inputs + resume. Leave Prompt Review's Pause off for this automatic first test.

7. Queue and review the result. For reference-driven scene prompts, follow the analysis and prompt-review sections below. To continue a longer plan, select the saved run and follow the Resume steps.

The lip-sync example uses the Audio Timeline Planner's warmup_reset strategy. Opening warmup seconds controls the first FL2VA part; Reset warmup seconds controls later resets. Try 1 second for the opening. The later-reset example uses 3 seconds; reducing it to 1 second is a useful comparison for fast-cut videos. Check the retained movement and joins after changing either value.

Opening warmup generates hidden frames with silent guide padding before audio time zero, then removes them. It does not trim the beginning of your recording or shift the retained video against it. 0 seconds keeps the original opening behavior and is the default for older workflows without this control. Ref2VA uses Reset warmup for its opening too.

Opening pose: Warmup can help the prompt take effect before the first retained frame, but the reference still influences the pose. For a very short opening scene, use an image already close to the intended posture. Check the planner report's opening crop instead of assuming the reset warmup also applies to the first part.

Hidden frames consume render capacity. Opening warmup can therefore make a long scene need an extra render part. With one FL2VA image, no cut times and an empty next-part list, extra parts continue from the preceding generated frames instead of resetting to the original image. Explicit cuts keep their configured reset behavior.

Fast-cut cost: each lip-sync task renders at least 124 frames before cropping, even if the retained shot is very short. Reducing warmup does not always reduce that minimum. Use Scene Cut Limit to reduce unnecessary cuts and compare a short excerpt before rendering a dense edit.

First run: native H3 from text or images

1. Choose Native H3 and select the matching loader and LoRA presets.

2. For a manual text test, turn Live analysis, Reference video, Audio override, YuE2 and MiniMax Music 3 off in START HERE. Leave the upscale and caption groups muted.

3. Set reference_mode on Video loop · saved inputs + resume to text_only. Turn Images off too when you do not need them.

4. Write Native H3 global direction + sound, then the manual first-part prompt. Clear old next-part text and cut times for a single-scene test.

5. Set Duration in Total duration + maximum render window (native H3), for example 8 seconds. This duration is used when neither audio nor a reference video supplies the length.

6. Choose New run, persistent disk storage and one part per queue. Queue and review.

To use an image, turn Images on, select your file and change reference_mode to first_only. For endpoints, add two images and select first_and_last.

Native H3 builds longer videos from short renders. Max clip frames = 362, for example, is about 15 seconds at 24 FPS. Longer scenes split into additional renders while keeping their scene prompt and image assignment. Those renders are independent; a shared prompt or image does not guarantee continuous movement or generated sound at every join.

Generate, resume and replace parts

The operation dropdown has four choices:

OperationWhat it generatesSaved result with Disk + Keep in outputNew runA fresh plan from the current source controlsA new run folderResume saved runUnfinished parts, or part N onward when Restart part is NA new revision folder when generatingUpdate selected runExactly one already saved part N; all other parts are retainedThe same folder, with a backup of its previous versionLoad saved runNothing; loads the current version or selected backupReuses saved media for preview, upscale, captions or export

Save a run that survives a restart

In Video Run Storage, enable Disk and Keep in output. With the output directory runs, working runs appear beneath ComfyUI/output/runs/. New runs and resumed revisions receive their own folders; Update keeps the selected folder. The final delivery video uses the separate Smart Folder destination, for example video/H3 with a date subfolder.

• Disk + Keep in output: retains completed parts and the saved inputs needed to resume after restarting ComfyUI.

• Disk + Temporary: reduces accumulated memory use, but the working files follow the temporary cache lifetime.

• RAM: keeps decoded parts in CPU memory. It uses more RAM and is not persistent across a restart. Preview and final export still create video files.

Recommended: Use Disk + Keep in output while developing a video. Every completed part is saved, so a later interruption does not discard the earlier work.

New run

Select New run when starting a new video or changing its source material, prompts or timing plan. It resolves those inputs and begins a fresh run on each queue.

Parts per queue controls how much work happens before returning:

• 0 renders all remaining parts.

• 1 renders one new part for review.

• A larger value renders that many new parts, or stops earlier when the plan is complete.

Important: Queueing New run again starts another run. To build on what you just generated, select its saved run and change the operation to Resume saved run.

Stop at a useful review point

Click Render loop · stop after current part → Stop after current part on the main canvas, below the render seed controls in Shared H3 render loop. It lets the current part finish, saves it, updates the accumulated preview and then stops the loop. You can use it without opening the subgraph or queueing again. The button inside Video Loop Start works too. For predictable step-by-step work, set Parts per queue to 1 before queueing instead.

The preview contains all retained parts so far, including the latest transition. In lip-sync mode, use it to judge the movement and audio around the warmup-trimmed join, rather than judging the new clip on its own.

An immediate ComfyUI cancellation can interrupt the current generation. Previously committed parts remain saved; the unfinished part must start again when resumed.

Resume an unfinished run

1. In Load Video Run, click Refresh runs and select the run you want to continue. Check Run progress + saved path or Saved run / part ranges if several runs look similar.

2. In Video Run Storage, select Resume saved run. Keep Disk + Keep in output enabled for the new result.

3. Keep the matching Lip-sync / Native H3 path, H3 model and LoRA setup selected.

4. Set Restart part = 0. This means continue after the last completed part.

5. Set Parts per queue to 1 for another review step, or 0 to finish the remaining plan.

6. Change Render seed · change before queueing if you want a new seed for the next generated parts, then queue.

Resume restores the saved prompts, timings, reference images, canvas and audio. It does not request another reference-analysis pass. Loaded model objects are not stored with the run, so the selected model, LoRAs and sampling settings still matter.

A completed run resumed with Restart part 0 returns the completed media without generating more parts.

Replace a bad part and the remaining ending

Suppose parts 1–6 look good, but part 7 has an unwanted gesture or appearance change:

1. Stop after the current part, or wait for the queue to finish.

2. Select that saved run and choose Resume saved run.

3. Set Restart part = 7. Part numbers start at 1; use the part-range report to find the correct number.

4. Change the Render seed before queueing. Leave Parts per queue = 1 to review the replacement first.

5. Queue. Parts 1–6 are retained as saved media; part 7 is generated again.

6. Review the accumulated preview, including the join from part 6 to the new part 7.

7. Select the newly created run, set Restart part back to 0, and resume to continue its ending. To try part 7 again, keep the restart value at 7 and choose another seed.

Persistent resume writes a new run folder and leaves the original run available for comparison. Before the next continuation, refresh the list and select the new revision you want to build on.

Resume scope: In Resume saved run, Restart part N replaces N and everything after it. To keep the saved ending, use Update selected run below. A long scene can contain several render parts, so scene numbers and part numbers may differ.

Do not delete individual part files to force a restart. Use Restart part instead; deleting files can make the saved run incomplete or unloadable.

Replace one part and keep the saved ending

For example, to replace part 13 of a completed 34-part run:

1. Select the source in Load Video Run.

2. In Video Run Storage, choose Update selected run. Keep Disk + Keep in output enabled and the loader's backup on Current run.

3. Set Restart part = 13 in Video loop · saved inputs + resume. This is a one-based render-part number.

4. Optionally change the render seed or edit part 13 through Part Prompt Editor and enable Apply edits. Clear pending changes to other parts you are retaining.

5. Queue once. Exactly part 13 is generated, regardless of Parts per queue. The final output contains original parts 1–12, the new part 13, and original parts 14–34.

6. Keep the same run selected for the next correction. Each successful update preserves the previous version as a backup inside that folder, including its prompts and seeds. The connected prompt editor reloads the newly saved text.

The replacement uses the saved duration, dimensions, FPS, references and audio timing. An external master soundtrack is preserved; Native H3's generated audio remains inside each retained clip. The in-loop preview shows the retained beginning and the new part; Loop End returns the assembly with the saved ending for final preview, upscale, captions and export.

Choose an already saved part; 0 is not a replacement selection. With a partial source, all completed parts are retained and the result remains partial. Ordinary Resume can finish it later. An interrupted or failed Update selected run leaves its current version intact; keep Current run selected and retry. If another update or restore changes the run during generation, the older attempt cannot overwrite it.

For lip-sync parts that continue from preceding generated frames, the preserved following part still reflects the old motion. The plan report identifies this dependency; review that join. Independent image resets, such as camera-cut parts, are suited to separate replacements.

Preview or restore an earlier version

1. Keep the run selected in Load Video Run and click Refresh runs to refresh its backup list.

2. Choose an entry in backup. Use Load saved run and queue to preview/export that version, or click Read selected run to inspect its saved prompts. This selection does not change the current run.

3. Click Restore selected backup to make it current without generation. The version being replaced is backed up too, so you can return to it later.

4. The selector returns to Current run. Connected prompt editors reload the restored prompts and reset pending edits with Apply off. Use Update selected run, choose another saved part, and enable your new prompt edit when ready.

Backups themselves are read-only; restore one before updating it. A partial backup restores only the parts saved at that point. The first Update backs up the selected run as it was before that correction, so you can restore that starting version later. Existing sibling run folders are not imported into its history; select an older folder separately if it predates your first backup.

Keep the whole run folder, including hidden .backups/ and .versions/ folders. run.json identifies the active media and checkpoint after updates; initial root-level metadata is historical. Unchanged media is shared through hard links where supported. History is retained, so storage grows with new generated parts; do not delete individual files to manage revisions.

Correct the prompt for a specific part

If changing the seed keeps producing the same unwanted gesture, check the prompt itself. For example, conflicting hand positions can make a short scene difficult to generate.

1. Select the saved run in Load Video Run. The editor uses this same selection.

2. In Part Prompt Editor, click Read selected run. This reads the saved text and timing without loading a model or generating anything.

3. Choose the Render part by its number and time range, or use ◀ / ▶ beside the dropdown to step through prompts. These controls follow the selected Eclipse theme; switching parts keeps your pending edits. Edit the text, keeping one clear description of the pose and movement. For example: “Both hands already rest on the table. The subject nods once while singing to the supplied audio.”

4. Turn Apply edits on. To correct only this saved part, choose Update selected run, keep Disk + Keep in output and backup = Current run, and set Restart part to its number. Clear pending changes to other retained parts.

5. Optionally change Render seed and queue. Update renders that one part and returns the assembly with its saved ending. Keep the same folder selected for another correction.

To change several parts or regenerate the ending, choose Resume saved run instead. Set Restart part to the earliest changed completed part, or 0 for upcoming parts in an unfinished run. Keep Parts per queue = 1 to review each new part, and select the new revision before continuing it.

Full replacement: The editor shows the combined global and scene prompt for that render part. Your text replaces it completely; the conflicting original text is not added again. Keep the performance direction and any native H3 sound instructions you still want.

Saved corrections: Edited prompts persist even with Apply edits off. Update selected run keeps the folder selected and saves the previous version as a backup. Resume saves a separate revision; select its new folder to continue.

The editor leaves timing, reference images, audio selection and lip-sync warmup as saved. It changes only the selected parts' prompts. Resume saved run replaces that part and the remaining ending; Update selected run keeps all other saved parts and accepts changes only to the selected part. Part numbers identify actual renders, so a long scene split into several parts can have just one of those prompts corrected.

Reset this part restores the text you read from the selected revision. Clear edits removes pending edits and turns Apply off; it does not change saved files. Reading an edited revision again removes pending edits already saved there. Clear drafts before reading a different run, or turn Apply off to resume that run without them.

Seeds and edits during resume

The Render seed is connected to generation independently of the upstream analysis and planning. Changing it before the next queue changes the newly rendered parts; it does not regenerate the retained beginning. Different seed per part varies the seed across part positions.

The current queue already has its settings. Editing the seed while it is running does not change the clips still being generated in that queue. Stop, adjust, and queue Resume or Update again.

Saved-input rule: Resume and Update restore the saved inputs and then apply enabled Part Prompt Editor changes. Editing the ordinary manual prompt boxes does not affect either operation. Use New run for a changed timing plan or new source material. Part Prompt Editor and seed changes take effect on the next Resume or Update queue. Prompt Review's Continue applies edits during the waiting New run.

Load a run for captions or export

Select a run and choose Load saved run to reuse its media. This skips generation, analysis and fresh planning, so you can change caption styling or output settings and export again. The source audio loaders stay inactive; the saved run supplies its own recording.

Keep the whole run folder if you move or back it up. It contains the ordered parts, audio and input checkpoint. NumPy .npy files hold pixel or saved-input arrays; they are not independently playable videos. The manifest tells the loader how those files belong together.

To reuse a moved run, place its complete folder under ComfyUI's output directory and click Refresh runs. Older media-only runs can be loaded for export but need a render checkpoint to support Resume or Update. Saved output runs remain until you remove them, so clean up unwanted revisions when you are finished.

Scene prompts and cut times

Each scene receives the global direction plus its own part prompt. A list of scene prompts is not sent as one long instruction to every clip.

• Global prompt: the performance or visual direction that applies throughout.

• Manual first part: the opening framing, pose and movement.

• Manual next parts: one nonempty line per subsequent scene. Keep each description on one line; the workflow carries these as a list.

• Manual cut times: comma-separated seconds from the start of the selected excerpt.

For a 40-second video, cut times 8, 23, 31 create scenes lasting 8, 15, 8 and 9 seconds. Use one first-part prompt and three next-part prompts.

Times must be strictly increasing and inside the selected timeline: greater than 0 and earlier than its end. H3 rounds them to native 24 FPS frames; cuts must remain distinct after rounding. Recheck the times after changing the excerpt or soundtrack.

Live analysis has priority while enabled. To use manual times and prompts, turn Live analysis off. The Reference video group can remain on to supply duration and audio. A nonempty manual field does not override the active live-analysis source.

In Lip-sync with one image, any number of valid manual cut times can create separate shots using that same reference. In Audio Timeline Planner, use Original image for technical splits and Camera cut for per-shot directions, with nonzero reset warmup. Supply the opening prompt and one next-part line per cut; additional render splits inside a shot keep its direction. With multiple images, timings assign image changes as described in Reference images for lip-sync scenes.

In Native H3, blank cut times divide the duration equally between the supplied scene prompts. Explicit times, including measured reference-video times, take priority. For a single global performance, clear the cut times and all part-specific text.

Write compact generation directions. For example:

Global: The subject performs naturally to the supplied audio with synchronized lip movements.

First part: Medium close-up with a static camera. Both hands are already beside the temples; the index fingers make small circles while the eyes widen.

Next part: Tight close-up. The subject lowers their chin slightly, holds eye contact and gives a brief sideways smile.

There is no need to write clip timestamps, warmup instructions or audio-priority rules into these paragraphs. The workflow handles timing and audio selection. A gesture already in progress should be described that way, especially when the scene is short.

Review and edit prompts before generation

Prompt Review, titled First + next scene prompts · review, sits after the live/manual prompt selection. It receives the opening prompt separately and the remaining prompts as a list, so both sources can be reviewed in the same place. The global direction remains in its own controls; change it before queueing.

Pause is off by default. The node displays the received text and passes it through unchanged. Saved drafts do not apply in this mode. To edit the prompts before a New run starts rendering:

1. Choose your live or manual source, then enable ⏸ Pause on Prompt Review before queueing.

2. Queue New run. When the prompts arrive, execution waits at the review node.

3. Select First prompt in the dropdown to inspect the opening scene. Use the ◀ / ▶ arrows beside the dropdown to move through later prompts. Switching entries keeps your edits; the dropdown and buttons use the selected Eclipse Nova design theme.

4. Edit each scene in place. Keep one paragraph per prompt, because the H3 planner uses one line per scene when the list is joined. Correct the action, overall pose and framing; remove contradictory or unsupported details. Edit the existing item rather than deleting it, so scene order stays intact.

5. Press ▶ Continue once to pass all reviewed prompts to planning and generation in this same run. The analysis or manual source is not rerun, and no copy/paste into the manual fields is required.

Reset this prompt restores the selected incoming text. ■ Cancel run cancels the waiting run without passing partial edits downstream. ComfyUI's interrupt control also works. While paused, the queue remains occupied and already loaded models remain loaded.

Saving the workflow retains the editor text. With Pause on, drafts can prefill another review only when all incoming prompts and their order still match; you must press Continue again. Changed input starts a fresh review. Refresh status reconnects to a waiting review in the same browser session after reopening the saved workflow. A nonempty prompt cannot be cleared completely.

The workflow routes reviewed opening and later prompts into both the lip-sync and native H3 paths. It keeps cut times and global direction on their existing routes. Reviewed prompts become part of the resolved inputs saved with the new run; the earlier saved scene-analysis file still contains the original analysis. Raw analysis previews may therefore differ from the edited text in Prompt Review.

Which review control should I use?

ControlWhen to use itWhat happens nextPrompt Review → Pause / ContinueInspect scene prompts before a New run rendersContinue uses your edits in the waiting queue, without rerunning analysisRender loop → Stop after current partInspect generated video and its latest joinThe current part finishes and is saved; select its run and queue Resume to continuePart Prompt Editor → Apply editsCorrect a particular render part of a saved runQueue Update for one saved part, or Resume from the earliest changed part

Resume, Update and Load use saved inputs and skip the New-run prompt-review route. Prompt Review edits scene text before global direction is combined; Part Prompt Editor shows the complete combined prompt for each render part. A scene split into several render parts shares its reviewed scene description initially, but those saved parts can later be edited individually.

Use a reference video for cuts and movement

Enable Reference video, load the clip and choose the excerpt you want. Enable Live analysis to measure its scene boundaries and describe the action inside each scene.

For a lip-sync motion-transfer example, keep your character image and recording selected, choose Scene Motion Analysis in Smart LM and Exclude source appearance in Scene Analysis to H3. Enable Prompt Review's Pause if you want to correct the descriptions before rendering. This task choice describes motion; the Lip-sync / Native H3 switch still chooses the generation path separately.

The workflow uses two separate passes:

• Scene Detector scans the source frames on CPU for hard cuts and persistent appearance changes across short blended transitions. 128 px longest side is a starting point. The added gradual_threshold and gradual_min_change controls adjust the blend check; their defaults are 2.3 and 0.2. The existing Scene Detector node includes this behavior; no separate v2 node is needed.

• Smart LM describes only the sampled frames from each scene or window. Longest side controls image size in Frames mode; Grid tile side controls it in Grid mode. 512 px is an example for either. A larger size can preserve more facial or hand detail, with additional memory and processing cost.

For more movement coverage, the current example selects 16 frames per scene, a maximum of 16 per Scene Analysis Plan window, and 2 overlapping samples when more than one plan window is needed. Smart LM uses Grid, 8 frames per grid and 512 px tiles. It analyzes bounded groups and combines their observations into one result for the supplied window. An eight-sample plan is a lighter starting point. Raising only the window limit does not select more frames.

Inside MMH3 Reference Analysis, Scene Analysis Plan creates those windows. The loop sends each one through Scene Frame Sampler and Smart LM Loader, with the frame context carried by Smart LM Prompt Pipe. Scene Description Collector gathers the results in order, Save Scene Analysis stores them, and Scene Analysis to H3 produces cut times plus the separate first/next prompts. Prompt Review receives the selected prompts after that conversion.

The Smart LM Unload step releases retained analysis models before H3 generation. Keep it connected when the analysis model and H3 share GPU memory.

Every Nth frame in Scene Analysis Plan samples original video frames. In Smart LM it subsamples the images it receives. Usually leave the LM stride at 1 if you already reduced the selection in the plan. Longest side 0 uses the loader's automatic model limits; a positive size is still bounded by supported limits.

Scene Cut Limit controls how dense the editing can be. 0 keeps all detected cuts; a positive value sets the maximum cuts per second. 2 requires at least half a second between retained boundaries, while 1 requires one second. A stricter positive limit merges some scenes without moving the retained cuts, so it also changes what each description must cover.

An outfit blend can now produce separate descriptions before and after the transition, but detection remains approximate. A same-background pose jump may still be missed. Denser LM sampling or stronger instructions do not add cut times to the plan. Review the detector report and prompts; for exact missing boundaries, enter a complete manual cut/first/next set and turn Live analysis off. No detected cuts is valid and produces one scene with no next-part prompts.

Disk frames, Frames/Grid and scene coverage

The sampler supplies frames through Smart LM's frame_source socket. These are the selected source images loaded for the active request. Every task that supports image input can use this source, including ordinary descriptions and image-capable MiniMax H3 tasks. Connect images or frame_source, never both. The chosen model still needs vision support.

• Frames + Together on: send the ordered selection together on a supported vision backend. Use this for scene action and changes between frames. Explicit Together uses the supplied selection without the older Max frames tail limit.

• Frames + Together off: one request per supplied image. This is useful for individual captions, but separate stills give the model no cross-frame motion to compare. Florence and WD14 use individual processing for multiple images.

• Grid: arrange samples as numbered chronological tiles. Grid implies Together, uses bounded groups with overlap, and adds a text-only merge when more than one group is needed. The result retains one scene/window identity for the collector. Grid does not create extra scene cuts.

• Native VIDEO: Smart LM also accepts a video directly on its image/video input and samples it into bounded windows. In this workflow, keep the detector → scene sampler route when you want the measured boundaries and per-scene prompts.

• Text tasks: tasks that allow visual context can use images with a supported vision model. Text-only tasks and models ignore connected media. MiniMax H3 T2VA Timeline is text-only; it is a different task from Scene Description (T2V).

Together sends the selected samples after the LM stride, rather than every decoded video frame. With stride 1, the selection includes the window's first and last samples. The dedicated Scene Motion Analysis and Scene Description (T2V) tasks remove exactly black samples; an entirely black selection keeps an explicit Black screen. entry instead of losing a scene. Other tasks keep their own image behavior.

The opening prompt has its own output. Scene Analysis to H3 returns first_part_prompt for scene 1 and next_part_prompts starting at scene 2. Looking only at the next-part preview can make the opening scene seem missing. Prompt Review shows the opening as First prompt, followed by the later scenes. The planner and saved-run part report show what will actually be rendered.

Joining three source clips does not imply three final scenes: detection can find additional cuts within each clip. Sampling windows describe portions of a scene, while render limits can split one scene into several generated parts. Use the measured frame/time ranges when comparing source clips, scenes and render parts.

Choose the description task for your purpose

Smart LM taskWhat it describesScene Analysis to H3 settingScene JSON buttonScene Motion AnalysisTransferable camera framing, pose, action, gaze and expression; the target image supplies appearance and settingExclude source appearanceNot required; the task already returns structured scene observationsScene Description (T2V)Visible subjects, appearance, clothing, setting, lighting and motionInclude source appearanceNot required; the task already returns structured scene observationsSimple / Detailed / Ultra Detailed DescriptionThe task's ordinary scene caption, at the requested level of detailInclude source appearanceOn when connected to the scene collectorMiniMax H3 Scene or an image-capable H3 Timeline taskH3-style prompting from the ordered scene samples when Together is onInclude source appearanceOn when connected to the scene collector

For lip-sync with a separate character image, use the first row as the starting point. Scene Motion Analysis requests transferable performance direction and omits source appearance throughout its output. Scene Description (T2V) includes appearance in its generation paragraph. Both accept the source video, image batches or detector-provided frames. T2V means the downstream generator has no separate appearance reference image; it does not mean the analysis receives no images.

For a source-video-driven T2V run, keep Reference video and Live analysis enabled, select Scene Description (T2V) with Include source appearance, and choose Native H3 → reference_mode = text_only for generation. The source video supplies the descriptions and timing without becoming a character reference image.

Both scene tasks request framing from the body extent visible in each frame, the existing starting pose and distinct movement phases. Hair movement and contact remain valid in motion-only descriptions; hair color, length and style remain excluded. Neither task should invent connecting movement across a pose jump or infer speaking/singing from routine mouth motion. Full T2V descriptions retain visible clothing and setting changes without inventing an action to explain an edit. These are model instructions, so compare doubtful descriptions with the source.

The appearance dropdown must match the task. It does not rewrite a full caption into a motion-only description. Switching from motion-only to full descriptions requires another analysis run to obtain the omitted appearance. Keep the task consistent throughout one analysis loop.

Ordinary Simple, Detailed and Ultra Detailed tasks cover action, visible people and their appearance, overall pose, camera angle, background and lighting. Simple is concise; Detailed develops the scene; Ultra Detailed asks for fuller connected paragraphs with distinct visible details. Each uses its own editable instructions. Ultra Detailed is a request for more supported detail, not a minimum length or a guarantee of greater accuracy. Natural poses such as “seated with legs crossed” are usually clearer than a forced inventory of every limb. Unshown or uncertain details should be omitted.

With Together on, image-capable H3 tasks use the whole selected sequence for one scene description. Intermediate samples remain available, and first/last reference roles retain their endpoints. An empty user prompt in this scene-analysis route does not request a new invented story. Normal single-reference/text prompting outside this route retains the H3 task's own behavior.

Scene JSON: ordinary text versus collector input

Scene JSON defaults to off in Smart LM's Mode bar. Keep it off when an ordinary task's text goes directly to a prompt consumer. Enable it when ordinary image descriptions or H3 output feed Scene Description Collector.

With Scene JSON on, SmartLLM builds the JSON container in code around the task's normal answer. The model keeps its usual instructions and does not need to format a new JSON schema; packaging adds no inference call. The container preserves the original answer and supplies the scene paragraph and IDs required by the collector. For H3 responses, the visual-description field becomes the scene prompt; its soundscape/music fields remain in the original answer, and audio selection stays with the workflow.

Scene Motion Analysis and Scene Description (T2V) already request structured observations. Their format stays the same with Scene JSON on or off. SmartLLM accepts supported wrappers and simple field variations, and can make one correction attempt for invalid structure. A persistent structural failure still reports its scene/window and saves the response for inspection. A format error from an ordinary task with Scene JSON off is therefore different from a truncated structured response.

Usable structured descriptions with content review warnings remain available for editing. JSON packaging keeps ordinary text from breaking the container; it cannot fix a wrong pose or invented action. Review the words before using them for generation.

Task instructions and Thinking

Open Smart LM's Tasks panel to select a task and review or edit its instructions. Current SmartLLM uses one instruction set per task; the former Training and Standard/NSFW switches have been removed. Task instructions, source images and your additional guidance determine the request. A connected custom system prompt replaces the selected task's instructions and must preserve the format required by the collector.

The bundled visual instructions describe supported visible detail directly and omit concealed or unsupported features. Customized tasks and deletions are preserved during updates, so local instructions can differ from the current defaults. Review or restore a customized task's bundled instructions when you want the latest wording. Existing saved descriptions need a new analysis pass or manual prompt edits; updating instructions does not rewrite them.

Thinking defaults to off. Leave it off for a straightforward lip-sync description pass. Enable it when a supported model/template offers reasoning and you want to compare its results. It appears only on supported backend paths; an uncensored model label does not establish whether thinking can be switched.

Max tokens includes reasoning and the final answer. Thinking can therefore increase runtime or leave too little space for a usable description. The token progress bar measures the output allowance, not a reliable time-to-completion estimate, and the model may stop well before 100%. Native Qwen3/Qwen3.5 Simple/Detailed/Ultra Detailed captions have a bounded thinking allowance; that limit does not apply to every task or backend. If a scene run spends too long thinking, turn Thinking off before the next queue rather than assuming a larger token limit will improve the description.

Correct an analysis result

Review before rendering: A vision model can invent movement, miss a brief gesture or include unwanted appearance. Compare questionable scenes with the source. Use Prompt Review to correct the selected first and later prompts before Continue.

Live analysis has priority while enabled. Keep it enabled when editing its text through Prompt Review. For a fully manual plan or changed cut times, copy the complete cut/first/next set into the manual fields, edit it and turn Live analysis off. The reference-video group can stay on to supply its timing and audio. Changing the plan or source material requires New run; saved-part text corrections use Part Prompt Editor on Resume or Update.

The analysis group saves its original results under output/scene_analysis/ for inspection or later reuse. Its reports include scene/window information and available sampled-frame evidence. Prompt Review changes the downstream prompts, while the saved analysis remains available to compare with those edits.

Reference images for lip-sync scenes

In the lip-sync audio planner, enabled Load Image Timeline entries are successive image intervals. Image 1 starts at time zero. Supplied transition times assign image 2, image 3 and later images in order; use no more than one time per image change. If times are blank, all images are evenly spaced across the audio. If only some times are supplied, the remaining images are evenly spaced after the last supplied time, leaving those supplied boundaries fixed.

For a 12-second soundtrack:

ImagesTransition timesImage start times before frame rounding2Blank0, 6 seconds3Blank0, 4, 8 seconds320, 2, 7 seconds

The first-part prompt belongs to image 1; the first next-part prompt belongs to image 2, and so on. The global direction remains shared. Extra render splits inside an image interval retain its scene description. When partial timings leave extra images without a description, those images reuse the last supplied scene description. An empty next-part list shares the opening description across all image intervals. For fully timed or entirely evenly spaced plans, a shorter nonempty next-part list can cycle; supply one description per image for distinct directions throughout.

With one image, manual times create multiple camera cuts while reusing that image, as described under Scene prompts and cut times. With multiple images, measured scene cuts can drive image changes. A clothing change in an appearance-excluded source description does not supply new target clothing: provide the next reference image and switch it at the intended boundary.

Reference images for native H3 scenes

Load Image Timeline provides one place to load, order and crop images to the shared canvas. Choose the assignment in Video loop · saved inputs + resume → reference_mode:

• text_only — generate without using the loaded images.

• first_only — use the first enabled image at the start of every clip.

• last_only — use the last enabled image at the end of every clip.

• first_and_last — use the first and last enabled images as endpoints. With one image, only the start is anchored.

• first_per_scene — image 1 starts scene 1, image 2 starts scene 2, and so on. If there are more scenes than images, reuse the last image.

• first_middle_first (FMF) — exactly two images, used as image 1 → image 2 → image 1. Additional scenes keep image 1.

• adjacent_pairs — scene 1 uses images 1→2, scene 2 uses 2→3, and so on. Once no next image remains, the last image supplies a start only.

• reference_images — use up to nine visual references without fixing the opening or ending frame. Select a matching Ref2VA model; prompt tags such as <Picture 1> refer to enabled image order.

For three different native scene starters, load three images, select first_per_scene, and define three scenes through cuts or scene prompts. Image slots do not create scene cuts by themselves; FMF explicitly fills missing sections. This differs from the lip-sync planner's image intervals above. If one scene is split because of the render limit, its extra parts retain that scene's image assignment.

For a short alternate outfit followed by a return, load two images and select first_middle_first in Video loop · saved inputs + resume. Two detected/manual cut times delimit the middle appearance. With no supplied cuts, FMF divides the duration into three equal sections; with one cut, it keeps that time and halves the remainder. A single scene description is reused across the three sections. Separate descriptions stay in order, with the last supplied description reused when needed. With no cuts, only the first three descriptions are used. The loop report shows the resulting cuts.

To enter your own two times, use the manual timing fields with Live analysis off, as for other manual plans. Equal thirds will hold the second image much longer than a brief preview, so use explicit times for that effect. Start a New run after changing FMF or its timing; Resume and Update restore the saved assignment and prompts. This is a Native H3 option. Each short scene still renders at least 124 frames before cropping, and the assembled result uses scene cuts rather than a visible crossfade.

About fades: Image-timeline blending is not a crossfade between the final generated clips. The H3 assembly joins the planned parts. Lip-sync warmup helps prepare the next part; it is not a visible dissolve. This workflow does not provide a final clip-crossfade control.

Audio selection and timing

The shared audio choice follows this priority:

1. Audio override — an explicitly selected recording, or audio supplied by an enabled music-generation group.

2. Reference-video audio — when no override is supplied and the selected video has usable, unmuted audio.

3. H3-generated audio — in Native H3 when neither source supplies a recording.

A reference video without audio can still supply the duration and scene timing. With neither audio nor a video, Native H3 uses the planner's Duration. A silent but present audio track still counts as supplied audio; mute that source if you want H3-generated sound instead.

Lip-sync needs a recording and reference image. LS vocal isolation can guide the performance with separated vocals while keeping the selected full recording as the final soundtrack.

When using reference cuts with a separate audio file, align their excerpts yourself. Cut times are relative to the selected start; they are not automatically retimed to another song or tempo.

Optional music generation

In START HERE → Optional sources + analysis, turn on YuE2 or MiniMax Music 3 to create the recording first. Each switch activates its corresponding music group; turning it off mutes that group. The switches are independent, so keep only your intended generator on.

Also enable Audio override and set the full-song Load Audio → Source to Auto to receive generated audio. The music switch does not change either of these settings. Choose models, prompts and duration in the selected music group. For the lip-sync example using your own recording, leave both music switches off and use Selected file.

YuE2

Select the YuE2 checkpoint. With Auto Prompt off, write musical direction in Style and the sung words in Lyrics. With Auto Prompt on, describe the song in Smart LM; its selected text supplies the generator instead of those manual fields.

Enable ABC planning adds a musical-score planning pass before music generation. Smart LM prepares the style and lyrics; YuE2's native ABC generator creates the score. Leave both native generators in full mode for a normal song test.

Set the generation duration deliberately; 360 seconds is a full six-minute song, so use a shorter duration for testing. The group saves the full song as FLAC; the shared audio controls then select the excerpt for H3.

MiniMax Music 3

Choose its model, text encoder and audio VAE. With Auto Prompt off, use Caption for musical direction and Lyrics for sung text. With it on, edit the Smart LM request instead. A duration of 120 seconds generates a two-minute song; use a shorter duration for a quick test. This group also saves its full song as FLAC before the H3 excerpt is selected.

Time-saving tip: Reduce the music generator's duration when testing. Selecting a short H3 excerpt afterward still requires generating the full requested song first.

Optional video upscale

The Optional upscale · enable group to use group starts muted. Enable the whole group when you want a larger final video; mute the whole group again to use the original result. It works with both lip-sync frame timelines and native H3 VIDEO, including New, Resume, Update and Load saved run.

Choose an installed model in Upscale Video. PyTorch: models come from models/upscale_models; TensorRT: engines come from models/tensorrt/upscaler and require a compatible NVIDIA GPU, runtime and engine profile. The example engine is a local selection, so replace it if it is unavailable. No separate upscale model-loader node is needed.

Resize to = model uses the model's native scale. 2x/3x/4x choose an output scale; 1080p/2K/4K preserve aspect ratio with a 1920/2560/3840-pixel long edge. Custom uses the specified width and height. Start with batch size 2 and reduce it to 1 if memory is tight. Upscaling preserves frame count, timing and the selected soundtrack; it does not add motion frames.

All upscale wires remain inside its group. Get First checks the upscaled result variable before the original result. Captions also check the corresponding width and height variables, so they render at the selected output size. The save group chooses captioned video → upscaled video → original result, in that order, using whichever group is active. Muting the upscale group does not require rewiring captions or saving.

Upscaling runs on the assembled result after the render loop, before captions and the final save. The loop preview and saved generation parts keep their original resolution. For the shortest review cycle, leave upscaling off while generating parts, then select Load saved run, enable upscaling and queue the final export. Enabling it on every partial-run queue processes the accumulated video each time.

Optional lyrics and captions

Enable lyric extraction when you need to transcribe an existing recording. Review the transcript and correct the wording before using it as lyrics. For generated songs, the generator's selected lyrics can supply the caption text; manual full-song lyrics and correction fields are also available.

Automatic transcription and lyric alignment use the local Whisper large-v3 conversion. Download these five files from the supported Systran revision into ComfyUI/models/whisper/large-v3/:

• model.bin

• config.json

• tokenizer.json

• vocabulary.json

• preprocessor_config.json

These files are checked against that revision. Qwen3 · compare only is an optional alignment comparison. It needs Eclipse's additional Qwen dependencies and model setup; select Whisper for a first test without that extra pass. Follow the lyric-caption setup guide for installation details.

Enable lyric captions, choose a font and adjust the style. Review Caption alignment report, Clip-relative SRT, Full-song timing JSON and Cleaned lyrics. If a word was not aligned, check the report before adjusting its timing manually.

The run saves the complete caption recording and the selected excerpt start. Captions use that saved pair, so changing the current source controls cannot trim a loaded run again. With H3-generated sound, the workflow reads the audio from the assembled video; transcription then waits until that sound is available. Demucs is optional.

Use Load saved run while changing caption appearance, upscaling or re-exporting an already generated video. Leave captions off for a clean video. Captions render after optional upscaling; check the font size and margins at the final resolution. Older runs saved before caption recording/offset support use their saved soundtrack from zero; any manual timing JSON for those runs must match that recording.

Common fixes

• The wrong model runs after switching mode: select the matching loader preset and the separate LoRA preset as well as the generation path.

• A downloaded file still appears missing: select its real local filename. Provider names and your example subfolders can differ; a browser reload also clears pending automatic download assignments.

• The first prompt seems missing: select First prompt in Prompt Review. The next-part output starts at scene 2 by design; check the planner and saved-run part ranges before assuming source frames were skipped.

• The first scene keeps repeating: inspect the selected prompts in Prompt Review. Each next scene needs its own nonempty item, and Live analysis overrides the manual source while enabled.

• The opening looks like an animated still before the action starts: try one second of Opening warmup in the FL2VA audio planner, check that the opening prompt describes the intended pose and movement, and start a New run. Reset warmup alone does not change the first FL2VA part.

• “Manual transition times must be inside the audio timeline”: use increasing times inside the selected excerpt, not full-source timestamps. Remove times at zero, at the end or beyond it. With multiple lip-sync images, supply at most one time per image change; omitted later times are filled evenly.

• The detector misses an outfit transition or pose jump: inspect its boundaries and blend controls. More LM samples can improve descriptions but cannot add measured cuts. Use a complete manual timing/prompt set with Live analysis off when exact boundaries are needed.

• A no-cut scene fails with an empty-list error: update the Nova packs and restart ComfyUI. One scene with no next-part prompts is valid; adding a dummy cut is unnecessary.

• Clothing from the reference video appears: use Scene Motion Analysis plus Exclude source appearance, then correct unwanted details in Prompt Review. Check that your intended reference-image mode is enabled.

• T2V analysis does not use the source images: choose Scene Description (T2V) and Include source appearance. MiniMax H3 T2VA Timeline is the separate text-only task and ignores connected media.

• The collector reports “Expected scene JSON”: for ordinary description/H3 tasks, enable Scene JSON and use Together on. Increasing Max tokens does not turn ordinary prose into collector input. For dedicated structured scene tasks, inspect the saved response and address truncation or the reported missing field.

• Smart LM stops after thinking without an answer: turn Thinking off for the next description run, or allow more Max tokens if you deliberately want reasoning. Both share the output budget. A higher limit can also make the run longer.

• Smart LM hangs or keeps looping: click ■ (Stop LM) at the end of its Mode bar. It interrupts the current workflow and force-stops the selected managed Docker backend even with Keep loaded on; the next run can start it again. Native models stop at their available cancellation checks, so a blocked native call must return before cleanup finishes.

• The saved size has not changed: enable the entire upscale group and check Resize to plus the selected model. The render-loop preview remains at generation resolution; inspect the final save preview or Upscale Video's result report. Muting the group deliberately restores the original dimensions.

• Prompt Review edits are ignored: enable Pause before queueing, edit when it is waiting and press Continue. Pause off always passes the incoming text through, including when the workflow contains saved drafts.

• The queue waits at Prompt Review: press Continue or Cancel run. This is the selected pause, not a stalled model load. Use Refresh status to reconnect the editor, or ComfyUI's interrupt control if it is unavailable.

• The run list is empty: generate with Disk + Keep in output, then Refresh runs. Keep the complete saved folder under ComfyUI output.

• Resume makes no new video: a completed run with Restart part 0 is already finished. Set the part number to replace, or select an unfinished run.

• A replacement looks the same: change Render seed before queueing; changing it during execution does not change that queued job.

• Prompt edits do not affect Resume or Update: use Part Prompt Editor, click Read selected run, edit the numbered part and enable Apply edits. Resume starts at or before a changed completed part; Update requires that exact part and accepts no pending changes to other retained parts. The ordinary manual prompt boxes apply to New run.

• An earlier version is missing from the backup list: backups begin with the first Update in that folder. Click Refresh runs; older separate revision folders remain separate run selections.

• Memory runs out: use Disk, reduce generation resolution, and keep analysis windows bounded. Disk storage reduces accumulated decoded-frame memory; it does not remove the model's own VRAM requirements.

Further documentation

• Eclipse Nova README — installation and the full node documentation index.

• Smart Model Loader Nova README — model loading, presets, LoRA Stack and downloads.

• SmartLLM Nova README — vision models, backends, prompting tasks and image handling.

• Eclipse saved runs and resume — storage lifetimes and recovery details.

• Eclipse native H3 clips — image assignment, duration and audio behavior.

• Eclipse scene analysis — detection, frame sampling and description controls.

• Eclipse video upscaling — model formats, output sizes, soundtrack handling and memory use.

• Eclipse Prompt Review — pause, direct editing, navigation and same-run continuation.

• Smart LM Loader guide — task instructions, Frames/Grid, video and disk-frame input, Scene JSON and Thinking.