Simple WAN T2V Workflow for Self Forcing
Perfil de execução
Descrição da fonte
Simple WAN T2V Workflow for Self Forcing
Self Forcing trains autoregressive video diffusion models by simulating the inference process during training, performing autoregressive rollout with KV caching. It resolves the train-test distribution mismatch and enables real-time, streaming video generation on a single RTX 4090 while matching the quality of state-of-the-art diffusion models.
Update (i2v):
To use Vace, you will need to use a different checkpoint: https://huggingface.co/lym00/Wan2.1-T2V-1.3B-Self-Forcing-VACE/blob/main/Wan2.1-T2V-1.3B-Self-Forcing-DMD-VACE-FP16.safetensors
Comentário gerado por IA
Explicação gerada por IA com base nos detalhes da fonte e da configuração. As sugestões são claramente identificadas.
This workflow is for generating video with Self Forcing and the Wan Video 1.3B t2v base model. It supports T2V, I2V, and V2V workflows, using text, images, or video as inputs and producing video.
Self Forcing is described as autoregressive rollout with KV caching that simulates inference during training.
The documented task forms are T2V, I2V, and V2V, with video as the output.
Find it on Civitai at https://civitai.com/models/1668005; the listed publisher is Powerpuff.
It requires the `comfyui-videohelpersuite` node pack.
The listed manual model files are `umt5_xxl_fp8_e4m3fn_scaled.safetensors`, `wan_2.1_vae.safetensors`, and `Wan2.1-T2V-1.3B-Self-Forcing-DMD-VACE-FP16.safetensors`.
For Vace, use `Wan2.1-T2V-1.3B-Self-Forcing-DMD-VACE-FP16.safetensors` as the different checkpoint, and use `self_forcing_dmd.pt` as the T2V checkpoint.
Verify that the three listed model files are available in your setup before using the workflow.
Sugestão · não verificado
If you plan to use Vace, verify that the Vace checkpoint and T2V checkpoint match the task you want to run.
Sugestão · não verificado
Isso precisa ser editado?
Faça login para enviar uma solicitação de edição.
Fontes
1 fonteTrechos de fonte
1 trechoSource context: 5945 downloads · Type Workflows · Base model Wan Video 1.3B t2v
Download self_forcing_dmd.pt from https://huggingface.co/gdhe17/Self-Forcing/tree/main/checkpoints and use it as the t2v checkpoint.
Project website: https://self-forcing.github.io/
Estimativa de requisito VRAM
Estimativa indisponível
Os tamanhos de arquivos do modelo ainda não estão completos o suficiente para calcular este requisito.
Requisitos
Requisitos 4umt5_xxl_fp8_e4m3fn_scaled.safetensors
Arquivo não verificadoText encoder · SAFETENSORS · Unknown
VAE · Unknown
Wan2.1-T2V-1.3B-Self-Forcing-DMD-VACE-FP16.safetensors
Não resolvidoCheckpoint · Unknown
Pacote de nós · Registry