NIMnodes

NVIDIA NIM Nodes

What are NIMs?

NIMs are NVIDIA Microservices containers designed to run models in the most optimal manner for NVIDIA GPUs. This NIM provides support for the following models from Black Forest Lab's: Flux.1 dev, Flux.1-Depth-dev, Flux.1-Canny-dev,Flux.1-Schnell, and Flux.1-Kontext-Dev.

Experimental support is also provided for Stability AI SD3.5 Large, SD3.5 Large-controlnet-canny, and SD3.5 Large-controlnet-depth on GPUs with 32GB or more VRAM.

Getting Started with the FLUX NIM in ComfyUI

Before installing, ensure your system meets the following requirements:
Operating System: Windows 11 (22H1 or later)
GPU Compatibility information can be found here: NVIDIA NIM for Visual Generative AI (GenAI) GPU Support Matrix

GPU Driver: Version 572.83 or later
Virtualization Settings: Enabled in SBIOS - Instructions to enable virtualization if it is not enabled

The node can automatically detect if you have already set up NVIDIA NIM, if not, it will navigate to the NIMsetup.exe download page where you can download and install NIMs.
However it is recommended to installer from here and run NIMSetup.exe.

After the NIM setup has completed, please perform the following steps to start NIMs in Comfy UI:

1. Install ComfyUI
2. Open ComfyUI folder, clone this repo and put it under ...\ComfyUI\custom_nodes\
3. Go to ...\ComfyUI\custom_nodes\NIMNodes\and install the dependencies with the following command: pip install -r requirements.txt
4. If using the windows standalone ComfyUI install use this command ..\..\..\python_embeded\python -m pip install -r requirements.txt
5. A HuggingFace API token is required to access the Flux models. For information on how to create an access token see here
6. To avoid having to input your token into the NIM everytime you can set the HF_TOKEN environment variable.
7. Open a command prompt and type setx HF_TOKEN <hftoken_info> where <hftoken_info> represents your actual Hugging Face Token string.
8. Accept the use agreement for the FLUX models on Hugging Face
   1. Login into Hugging Face using the account associated with your access token

Navigate to: https://huggingface.co/black-forest-labs/FLUX.1-dev

image Accept the license agreement.

Repeat this step for the following model variants you wish to utilize:

Model	URL
FLUX.1-Canny-dev	https://huggingface.co/black-forest-labs/FLUX.1-Canny-dev
FLUX.1-Depth-dev	https://huggingface.co/black-forest-labs/FLUX.1-Depth-dev
FLUX.1-schnell	https://huggingface.co/black-forest-labs/FLUX.1-schnell
FLUX.1-kontext-dev	https://huggingface.co/black-forest-labs/FLUX.1-Kontext-dev
FLUX.1-dev-onnx	https://huggingface.co/black-forest-labs/FLUX.1-dev-onnx
FLUX.1-Canny-dev-onnx	https://huggingface.co/black-forest-labs/FLUX.1-Canny-dev-onnx
FLUX.1-Depth-dev-onnx	https://huggingface.co/black-forest-labs/FLUX.1-Depth-dev-onnx
FLUX.1-schnell	[https://huggingface.co/black-forest-