JonXL's DirectWan V6.0f - Wan 2.1 (+VACE Stand-In) + 2.2 Advanced V6 Workflow - T2I T2V I2V FLF2V (Trim, Extend, Upscale, Interpolate, Overlay)
Runtime profile
Source description
JonXL's DirectWan V6.0f - Wan 2.1 (+VACE Stand-In) + 2.2 Advanced V6 Workflow - T2I T2V I2V FLF2V (Trim, Extend, Upscale, Interpolate, Overlay)
Please do not redistribute this workflow or significant parts of it without my consent.| If for some reason download links are unavailable, please visit https://huggingface.co/JonXL to find a copy of the relevant files, use at your own risk)
A multipurpose workflow for generating text to video, text to image, image to video, first-last frame to video, with support for 2.1 VACE Controlnets + Stand-in, including a useful trimming feature. (64GB RAM + 16GB VRAM recommended)
Configure all models once (download links and folder paths in notes) and then switch between generation modes.
Sources
1 sourceSource excerpts
1 excerptSource context: 1283 downloads · Type Workflows · Base model Wan Video 2.2 I2V-A14B
Additional information can be read in the surrounding notes, explaining all features and configuration details.
Feel free to post your SFW generations on this page.
Happy prompting! - JonXL
Features:
Everything explained in notes with download links provided!
Allows for Wan 2.1, Wan 2.1 Vace + Stand-In (any combination), and Wan 2.2 Generation inside the same workflow. Canny, Pose (Face, Body, Hands) and Depth can be toggled with a single switch (!))
Allows for T2V, T2I, I2V and FFLF2V generation. Easily switch between T2V, I2V and FFLF2V per toggle.
Supports simple resize and rescaling of input images instead of cropping (using a single toggle)
Allows for infinite video generation, when loading the last generated input image manually (auto saved in a separate folder).
Includes a subproces of clip trimming, choosing the start and endframe of a generated video before saving the video.
Saves a comparison video for VACE generated clips (left: input video, right: output video)
Includes optional post processing upscaling and frame interpolation of the generated clip. (easy enable / disable through control panel)
Multi Lora loading
Sage Attention for performance (easy enable / disable through control panel) - recommended, but maybe hard to install.
Block Swap for 2.1 VACE enabled by default (21) - Useful for low VRAM GPUS (consider '39' for low VRAM and less for higher end GPUs)
Bonus: Overlay one image on top of another image (with auto background removal).
Bonus: Seperately load a video for upscaling or frame interpolation
Bonus: Join two videos together into a single video
Bonus: Separate workflow for joining up to 10 videos at once (with option to upscale and interpolate as well)
Possible future updates:
Rework of Wan 2.1 (Non-Vace) and 2.2 to use WanVideoWrapper instead of basic K-Sampler (as for now Wan 2.1 Vace needs non quantized Safetensors and Wan 2.1 / 2.2 is based on GGUF)
Other cool features
Extremely useful workflow to do everything you want with Wan 2.1 and Wan 2.2.
Please take your time to read the notes if necessary, or check out my less advanced workflows on CivitAi as well:
Note:
(!) When loading this workflow, make sure to load a random image in both Load Image nodes, and a Video in the Load Video node, regardless of whether you think the workflow actually needs them.
(the zip archive came with images and videos that you can use).
(while the image is not needed, ComfyUI likes to complains about it)
For T2I it is recommend to install the following custom_node to use "res_2s" + "bong tangent" sampler: https://github.com/ClownsharkBatwing/RES4LYF
Recommended usage:
Start using this workflow by zooming out and going from left to right.
(Initial setup)
Determine if you have Sage Attention installed, or try installing it following the notes.
Download and configure the necessary models (I2V, T2V, VACE, Clip, Vae, Loras etc), use the download links and put in the correct folder as mentioned in the notes.
(Normal use)
Configure which Wan version to use, which prompt, set video parameters.
Read the notes for additional information.
Press "Run" (or CTRL+ENTER) in ComfyUI to generate a preview of the trimmed clip.
Optionally use the "Dump frames" option in the Control Panel, to dump all frames to make it easier to find your start and end frame.
Now, optonally choose to enable Step 4.2 "Upscale and Interpolate (trimmed clip)" to also save the video but upscaled and interpolated.
(You can also do this later, if you joined all your clips together in a final pass I guess)
Change the seed in the KSampler of step 2 for a new generation on same prompt
Change the prompt in step 2 (different prompt) for a new generation on antoher prompt
Change the image (if in Image to Video mode) in "Load image" and optionally change the prompt to generate from another frame.
Load the last frame from the ComfyUI\output\JXL\LastFrames\ folder to continue generating from the last frame of the clip you just generated.
Folder structure:
Output\JXL\Clips\ - All initial generated clips, untrimmed
Output\JXL\FirstFrames\ - First Frames (can be used
Output\JXL\LastFrames\ - Last Frames (useful for the Load Image node to continuing clip generation)
Output\JXL\Trimmed\ - Trimmed videos when saved
Output\JXL\Processed\ - Processed videos (based on the trimmed videos), upscaled and interpolated
Output\JXL\Compare\ - Saves VACE generated compare videos with input video (left) and output video (right)
All files are prefixed with 'w22'.
Please leave a like, comment and feel free to upload any SFW content you made using this workflow on the workflow's CivitAI page.
Happy prompting!
Pro tip:
Go to settings (cog wheel) -> Keybindings -> Search for 'Canvas Toggle Link Visiblity', set a keybinding (SHIFT + [+] ) and press it to toggle the node's lines.
Remaining hardware or download-size estimates are not available yet.
Requirements
depth_anything_vitl14.pth
Not resolvedCheckpoint · Unknown
dw-ll_ucoco_384_bs5.torchscript.pt
Not resolvedCheckpoint · Unknown
LoRA · 1.17 GB · Civitai · 1585622
Upscaler · Hugging Face · ishaansutaria35/RealESRGAN_x2plus
Checkpoint · Hugging Face
Stand-In_wan2.1_T2V_14B_ver1.0_fp16.safetensors
Not resolvedLoRA · Unknown
Checkpoint · Hugging Face
Text encoder · 3.77 GB · Hugging Face · MonsterMMORPG/Wan_GGUF
VAE · 134 B · Hugging Face · Comfy-Org/Wan_2.2_ComfyUI_Repackaged
Checkpoint · 5.68 GB · Hugging Face · Kijai/WanVideo_comfy
Checkpoint · 26.6 GB · Hugging Face · Comfy-Org/Wan_2.1_ComfyUI_repackaged
Checkpoint · 13.3 GB · GGUF · Unknown
Checkpoint · 11.6 GB · GGUF · Unknown
Wan2.2-I2V-A14B-HighNoise-Q8_0.gguf
Not resolvedCheckpoint · Unknown
Wan2.2-I2V-A14B-LowNoise-Q8_0.gguf
Not resolvedCheckpoint · Unknown
LoRA · 585 MB · Civitai · 1585622
LoRA · 585 MB · Civitai · 1585622
LoRA · 585 MB · Civitai · 1585622
LoRA · 585 MB · Civitai · 1585622
Checkpoint · 14.3 GB · GGUF · Unknown
Wan2.2-T2V-A14B-LowNoise-Q8_0.gguf
Not resolvedCheckpoint · Hugging Face · carlosrozas/Wan2.2-T2V-A14B-LowNoise-Q8_0
LoRA · Hugging Face · lgylgy/Wan21_I2V_14B_lightx2v_cfg_step_distill_lora_rank64
Wan21_T2V_14B_lightx2v_cfg_step_distill_lora_rank64.safetensors
Not resolvedLoRA · Unknown
yolox_l.onnx
Not resolvedCheckpoint · Unknown
ComfyMath
PossibleNode pack · Registry
comfyui_controlnet_aux
PossibleNode pack · Registry
Node pack · Registry
comfyui-crystools
FoundNode pack · Registry
comfyui-easy-use
FoundNode pack · Registry
comfyui-frame-interpolation
FoundNode pack · Registry
ComfyUI-GGUF
PossibleNode pack · Registry
comfyui-impact-pack
FoundNode pack · Registry
Node pack · Registry
Node pack · Registry
Node pack · Registry
comfyui-videohelpersuite
FoundNode pack · Registry
ComfyUI-WanVideoWrapper
FoundNode pack · Registry
efficiency-nodes-comfyui
FoundNode pack · Registry
masquerade-nodes-comfyui
FoundNode pack · Registry
rgthree-comfy
FoundNode pack · Registry
was-ns
Not resolvedNode pack · Registry