ComfyUI_FlashVSR

ComfyUI_FlashVSR

FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolution,this node ,you can use it in comfyUI FlashVSR_Plus,FlashVSR+ is an efficient one-step diffusion framework for high-quality video super-resolution, enabling spatially untiled 4K inference on a single 24GB RTX 4090 GPU.

Update

• use new loop / 换一个loop切分超长视频
• 支持flashVSR-Plus 模型，plus模式 请在菜单手动选triton-flashvsr_attn，否则还会是 自动选择Block-Sparse-Attention ，support flashVSR-Plus model，plus use triton attention，or auto will choice Block-Sparse-Attention
• | plus_temporal | 4 | 每 latent 帧的输入帧数；大运动视频建议 2 或 1（更慢） |

1.Installation

In the ./ComfyUI/custom_nodes directory, run the following:

git clone https://github.com/smthemex/ComfyUI_FlashVSR

2.requirements

pip install -r requirements.txt

• 1.optional requirements ( for flashvsr_attn) if use triton flashvsr_attn ,in the node dir 嫌弃编译麻烦的直接用这个，在插件目录下运行（如果是便携包，则复制operators整个文件夹到你的便携python包下，下面的安装命令加上 python -m）

pip install -e operators/flashvsr_attn --no-build-isolation --no-deps

• 2.optional requirements ( for Block-Sparse-Attention) if use Block-Sparse-Attention 要复现官方效果，可以安装Block-Sparse-Attention torch2.8 cu2.8 py311,torch2.12+cu130 py311 py313 wheel or CU128 toch2.7 origin method need this

git clone https://github.com/mit-han-lab/Block-Sparse-Attention  # if 5090 or newest cuda
# git clone https://github.com/smthemex/Block-Sparse-Attention # 无须梯子强制编译
# git clone https://github.com/lihaoyun6/Block-Sparse-Attention # 须梯子
cd Block-Sparse-Attention
pip install packaging
pip install ninja
python setup.py install

3.checkpoints

• 3.1.1 FlashVSRv1.0 all checkpoints 所有模型，vae 用常规的wan2.1
• 3.1.2 FlashVSRv1.1 all checkpoints 所有模型，vae 用常规的wan2.1
• 3.1.3 FlashVSRv-plus all checkpoints 所有模型，vae 用常规的wan2.1
• 3.2.1 1.0/1.1 emb posi_prompt.pth 4M而已
• 3.2.2 plus emb posi_prompt.pth 4M而已
• 3.3 lightvaew2_1.pth and diffusion_pytorch_model.safetensors

├── ComfyUI/models/FlashVSR
|     ├── LQ_proj_in.ckpt # v1.1 or v1.0
|     ├── TCDecoder.ckpt
|     ├── diffusion_pytorch_model_streaming_dmd.safetensors #v1.1 or v1.0
|     ├── posi_prompt.pth
|     ├──lq_proj_in_plus_turbo.safetensors   #rename turbo or base
|     ├── base_dit_plus.safetensors #rename base or turbo
├── ComfyUI/models/vae
|        ├──Wan2.1_VAE.pth # or safetensors  optional/可选
|        ├──lightvaew2_1.pth  #32.2M  or taew2_1.pth,lighttaew2_1.pth optional/可选
|        ├──Wan2.1_VAE_upscale2x_imageonly_real_v1_diff.safetensors  # rename from diffusion_pytorch_model.safetensors optional/可选

Example

Previous

• 如果觉得项目有用，请给官方项目FlashVSR and FlashVSR_Plus打星；
• Block-Sparse-Attention 源码库已更新，支持5090系显卡及更新的设备。注意，需要cuda>=12.8
• 编译Block-Sparse-Attention window的轮子 可以使用 smthemex 强制编译版 或者 lihaoyun6 要联网 两个fork来
• Block-Sparse-Attention 正确安装且能调用才是方法的完全体，当前的函数实现会更容易OOM,但是Block-Sparse-Attention轮子实在不好找，目前只有[CU1