JonXL Multi Wan 2.1 + 2.2 Advanced V5 AIO Workflow - T2I T2V I2V FLF2V (Trim, Extend, Upscale, Interpolate)
Perfil de execução
Descrição da fonte
JonXL Multi Wan 2.1 + 2.2 Advanced V5 AIO Workflow - T2I T2V I2V FLF2V (Trim, Extend, Upscale, Interpolate)
Consider upgrading to my latest (advanced) workflow, which now also includes Wan 2.1 VACE + Stand in https://civitai.com/models/1889006?modelVersionId=2138145
Comentário gerado por IA
Explicação gerada por IA com base nos detalhes da fonte e da configuração. As sugestões são claramente identificadas.
This ComfyUI workflow is for generating images and videos from text prompts, source images, or first and last frames; it can switch between Wan 2.1 and Wan 2.2 and between text-to-image, text-to-video, image-to-video, and first-last-frame-to-video modes, with outputs that include
Choose Wan 2.1 or Wan 2.2, select text-to-image, text-to-video, image-to-video, or first-last-frame-to-video, add a prompt, set video parameters, and run the workflow.
After generation, preview the first and last frames, optionally select a starting frame and frame count to trim the clip, save the trimmed video, and load its last frame to continue generating.
Inputs include a text prompt, source image, first and last frames, generation mode, video parameters, sampler steps, seed, and one or more LoRAs.
Outputs include generated images and clips, first-frame and last-frame previews, trimmed videos, and processed videos after optional upscaling or interpolation; files are organized under Output\JXL\Clips\, Output\JXL\FirstFrames\, Output\JXL\LastFrames\, Output\JXL\Trimmed\, and
Before use, download and place the I2V, T2V, CLIP, VAE, and related models using the links and folder paths in the notes.
When opening the workflow, load a random image in both Load Image nodes to avoid the initial Load Image error.
The workflow lists these node packs: ComfyMath, comfyui_essentials, comfyui-crystools, comfyui-easy-use, ComfyUI-GGUF, comfyui-impact-pack, comfyui-kjnodes, comfyui-logic, comfyui-logicutils, comfyui-videohelpersuite, rgthree-comfy, and was-ns.
Listed model files include RealESRGAN_x2plus.pth, umt5-xxl-encoder-Q5_K_S.gguf, wan_2.1_vae.safetensors, wan2.1-i2v-14b-720p-Q6_K.gguf, wan2.1-t2v-14b-Q6_K.gguf, Wan2.2-I2V-A14B-HighNoise-Q8_0.gguf, Wan2.2-I2V-A14B-LowNoise-Q8_0.gguf, and Wan2.2-T2V-A14B-HighNoise-Q8_0.gguf.
Other listed model files are Wan2.2-T2V-A14B-LowNoise-Q8_0.gguf, Wan2.2-Lightning_I2V-A14B-4steps-lora_HIGH_fp16.safetensors, Wan2.2-Lightning_I2V-A14B-4steps-lora_LOW_fp16.safetensors, Wan2.2-Lightning_T2V-v1.1-A14B-4steps-lora_HIGH_fp16.safetensors, Wan2.2-Lightning_T2V-v1.1-A4
Use the control panel to switch models and modes, set video parameters, resize or rescale images instead of cropping, load multiple LoRAs, change sampler steps, and enable or disable upscaling, interpolation, or Sage Attention.
For text-to-image generation, the notes recommend installing RES4LYF to use the res_2s and bong tangent samplers.
Before installing, verify the intended files and destinations for wan_2.1_vae.safetensors, RealESRGAN_x2plus.pth, umt5-xxl-encoder-Q5_K_S.gguf, and Wan21_I2V_14B_lightx2v_cfg_step_distill_lora_rank64.safetensors.
Sugestão · não verificado
Also verify Wan21_T2V_14B_lightx2v_cfg_step_distill_lora_rank64.safetensors, ComfyMath, ComfyUI-GGUF, and was-ns before installing; if groups do not appear in the control panel, check rgthree-comfy and consider version 1.0.25052900.
Sugestão · não verificado
Isso precisa ser editado?
Faça login para enviar uma solicitação de edição.
Fontes
1 fonteTrechos de fonte
1 trechoSource context: 759 downloads · Type Workflows · Base model Wan Video 2.2 I2V-A14B
*Downgrade node 'rgthree-comfy' to a lower version like 1.0.25052900, since their new bug prevents groups showing up in the control (bypass) panel *
A multipurpose workflow for generating text to image, text to video, (infinite) image to video, and first-last-frame to video, using a single switch, with a useful trimming feature.
Configure all models once (download links and folder paths provided in notes) and then switch between generation modes.
Zip Archive also includes JonXL's Top 10 Video Joiner Workflow (to join up to 10 videos, and upscale and interpolate optionally)
Stay tuned, Wan 2.1 VACE + Stand In integration coming soon (!)
Features:
Allows for Wan 2.1 and Wan 2.2 Generation inside the same workflow, just change 1 switch! (Preset to Wan 2.2)
Allows for T2V, T2I, I2V and First-Last-Frame 2V generation. Easily switch between T2V, I2V and FLF2V per toggle.
Supports simple resize and rescaling of input images instead of cropping (using a single toggle)
Allows for infinite video generation, when loading the last generated input image manually (auto saved in a separate folder).
Includes a subprocess of clip trimming, choosing the start and end frame of a generated video before saving the video.
Includes optional post processing upscaling and frame interpolation of the generated clip. (easy enable / disable through control panel)
Multi Lora loading
Sage Attention for performance (easy enable / disable through control panel) - recommended, but maybe hard to install.
Notes explaining most important steps of the workflow
Bonus (inside the workflow): Separately load a video for upscaling or frame interpolation
Bonus (inside the workflow): Join two videos together into a single video
Zip Archive also includes JonXL's Top 10 Video Joiner Workflow (to join up to 10 videos, and upscale and interpolate optionally.. very useful to join, upscale and interpolate clips all at once after generating the base trimmed clips)
By manually loading the last saved images, saved in a separate folder for ease of use, infinite video generation can be achieved.
Due to being able to trim the video before saving (and therefore also by choosing the last frame), more frames and clips can be salvaged.
Make sure to change the prompt (add a space for example) or manually select another seed in the KSampler if you want another clip generation based on the same frame.
When loading this workflow, make sure to load a random image in both 'Load Image' nodes. (perhaps the one that came with this workflow zip archive) to avoid the initial error for the "Load image" node.
(while the image is not needed, ComfyUI likes to complains about it)
The example Lora used in this model can be found here: https://civitai.com/models/1862320/wan22-t2v-lora-cartoon-style
For T2I it is recommend to install the following custom_node to use "res_2s" + "bong tangent" sampler:
Control panel can be found at the top of the workflow.
Recommended usage:
(Initial setup)
Determine if you have Sage Attention installed, or try installing it following the notes.
Download and configure the necessary models (I2V, T2V, clip, vae) etc, use the download links and put in the right folder as mentioned in the notes if necessary.
(Normal use)
You can also change the sampler steps globally if needed.
Finally, press "Run" to generate the video.
The first and last frame will be previewed once generation is complete.
Press "Run" (or CTRL+ENTER) in ComfyUI to generate a preview of the trimmed clip.
Optionally use the "Dump frames" option in the Control Panel, to dump all frames to make it easier to find your start and end frame.
Now, optionally choose to enable Step 4 "Upscale and Interpolate" to also save the video but upscaled and interpolated.
(You can also do this later, if you joined all your clips together in a final pass I guess)
Change the seed in the KSampler of step 2 for a new generation on same prompt
Change the prompt in step 2 (different prompt) for a new generation on another prompt
Change the image (if in Image to Video mode) in "Load image" and optionally change the prompt to generate from another frame.
Load the last frame from the ComfyUI\output\JXL\LastFrames\ folder to continue generating from the last frame of the clip you just generated.
Folder structure:
Output\JXL\Clips\ - All initial generated clips, untrimmed
Output\JXL\FirstFrames\ - First Frames (useful for backtracking)
Output\JXL\LastFrames\ - Last Frames (useful for the Load Image node to continuing clip generation)
Output\JXL\Trimmed\ - Trimmed videos, when saved
Output\JXL\Processed\ - Processed videos (based on the trimmed videos), upscaled and interpolated
All files are prefixed with 'w22'.
Thank you for reading this wall of text!
Please leave a like, comment and feel free to upload any SFW content you made using this workflow on the workflow's CivitAI page.
Estimativa de requisito VRAM
Estimativa indisponível
55,9 GB distribuídos em 8 de 15 arquivos de modelo. Total de arquivos do modelo + 25% de overhead de carregamento + 2 GB de buffer de execução, arredondado para cima.
Requisitos
Requisitos 27RealESRGAN_x2plus.pth
ConflitoUpscaler · Unknown
umt5-xxl-encoder-Q5_K_S.gguf
Não resolvidoText encoder · Unknown
VAE · Hugging Face · Comfy-Org/Wan_2.2_ComfyUI_Repackaged
Checkpoint · 13.3 GB · GGUF · Unknown
Checkpoint · 11.6 GB · GGUF · Unknown
Wan2.2-I2V-A14B-HighNoise-Q8_0.gguf
Arquivo não verificadoCheckpoint · Unknown
Wan2.2-I2V-A14B-LowNoise-Q8_0.gguf
Arquivo não verificadoCheckpoint · Unknown
LoRA · 585 MB · SAFETENSORS · fp16 · Unknown
LoRA · 585 MB · SAFETENSORS · fp16 · Unknown
LoRA · 585 MB · SAFETENSORS · fp16 · Unknown
LoRA · 585 MB · SAFETENSORS · fp16 · Unknown
Wan2.2-T2V-A14B-HighNoise-Q8_0.gguf
EncontradoCheckpoint · 14.3 GB · GGUF · Unknown
Wan2.2-T2V-A14B-LowNoise-Q8_0.gguf
EncontradoCheckpoint · 14.3 GB · GGUF · Unknown
Wan21_I2V_14B_lightx2v_cfg_step_distill_lora_rank64.safetensors
Não resolvidoLoRA · Unknown
Wan21_T2V_14B_lightx2v_cfg_step_distill_lora_rank64.safetensors
Não resolvidoLoRA · Unknown
ComfyMath
PossívelPacote de nós · Registry
Pacote de nós · Registry
Pacote de nós · Registry
Pacote de nós · Registry
ComfyUI-GGUF
PossívelPacote de nós · Registry
Pacote de nós · Registry
Pacote de nós · Registry
Pacote de nós · Registry
Pacote de nós · Registry
Pacote de nós · Registry
Pacote de nós · Registry
was-ns
Não resolvidoPacote de nós · Registry