Node packVerifiedExternal

ComfyUI_ExtraModels

Support for miscellaneous image models. Currently supports: DiT, PixArt, HunYuanDiT, MiaoBi, and a few VAEs.

Sourcegithub.com/city96/ComfyUI_ExtraModels

Maintainer@city96Bgrade

Package profile

Status: Verified
Publisher: @city96
Source: GitHub
Stars: 536

README

Extra Models for ComfyUI

This repository aims to add support for various different image diffusion models to ComfyUI.

Installation

Simply clone this repo to your custom_nodes folder using the following command:

git clone https://github.com/city96/ComfyUI_ExtraModels custom_nodes/ComfyUI_ExtraModels

You will also have to install the requirements from the provided file by running pip install -r requirements.txt inside your VENV/conda env. If you downloaded the standalone version of ComfyUI, then follow the steps below.

Standalone ComfyUI

I haven't tested this completely, so if you know what you're doing, use the regular venv/git clone install option when installing ComfyUI.

Go to the where you unpacked ComfyUI_windows_portable to (where your run_nvidia_gpu.bat file is) and open a command line window. Press CTRL+SHIFT+Right click in an empty space and click "Open PowerShell window here".

Clone the repository to your custom nodes folder, assuming haven't installed in through the manager.

git clone https://github.com/city96/ComfyUI_ExtraModels .\ComfyUI\custom_nodes\ComfyUI_ExtraModels

To install the requirements on windows, run these commands in the same window:

.\python_embeded\python.exe -s -m pip install -r .\ComfyUI\custom_nodes\ComfyUI_ExtraModels\requirements.txt

To update, open the command line window like before and run the following commands:

cd .\ComfyUI\custom_nodes\ComfyUI_ExtraModels\
git pull

Alternatively, use the manager, assuming it has an update function.

Sana

Original Repo

[!CAUTION] As many people have had issues with Sana, it's for now recommended to try the fork by the Sana devs, which auto downloads all models:

Readme | Fork repo

A full rewrite to have better integration is in progress in this PR but isn't ready yet.

https://github.com/NVlabs/Sana/blob/main/asset/docs/ComfyUI/comfyui.md https://github.com/Efficient-Large-Model/ComfyUI_ExtraModels

Model info / implementation

Uses Gemma2 2B as the text encoder
Multiple resolutions and models available
Compressed latent space (32 channels, /32 compression) - needs custom VAE

Usage

Download the model weights from the Sana HF repo - the HF account has alternative models available too.
Place them in your checkpoints folder
Load them with the correct PixArt checkpoint loader
Use the "Gemma Loader" node - it should automatically download the requested model from Huggingface - Recommended to use the 4bit quantized model on CPU when low on memory.
Download the VAE from here or here and place it in your VAE folder after renaming it.
Use either the "Empty Sana Latent Image" or "Empty DCAE Latent Image" node for the latent input when doing txt2img.

Sample workflow

Sana

PixArt

Original Repo

Model info / implementation

Uses T5 text encoder instead of clip
Available in 512 and 1024 versions, needs specific pre-defined resolutions to work correctly
Same latent space as SD1.5 (works with the SD1.5 VAE)
Attention needs optimization, images look worse without xformers.