ComfyUI workflow for the Union Controlnet Pro from InstantX / Shakker Labs. Available modes: Depth / Pose / Canny / Tile / Blur / Grayscale / Low quality
Perfil de ejecución
Descripción de la fuente
ComfyUI workflow for the Union Controlnet Pro from InstantX / Shakker Labs. Available modes: Depth / Pose / Canny / Tile / Blur / Grayscale / Low quality
Instructions:
Update ComfyUI to the latest version
Download the model to models/controlnet
Load this workflow
Select the correct mode from the SetUnionControlNetType node (above the controlnet loader)
Important : currently need to use this exact mapping to work with the new Union model:
canny - "openpose"
Comentario generado por IA
Explicación generada por IA basada en los detalles de la fuente y la configuración. Las sugerencias están claramente identificadas.
Use this ComfyUI workflow with Flux.1 D to apply Union Controlnet Pro to image generation: provide an input image, choose Depth, Pose, Canny, Tile, Blur, Grayscale, or Low quality, and produce preview and saved-image outputs.
Load it in ComfyUI, provide the input image, and select the mode in the SetUnionControlNetType node above the ControlNetLoader.
To extract control information from your own images, optionally install ControlNet Auxiliary Preprocessors; its openpose, depth, and canny extractors can replace the example image.
Input an image and choose one of seven modes: Depth, Pose, Canny, Tile, Blur, Grayscale, or Low quality.
The graph includes LoadImage, PreviewImage, and SaveImage nodes for loading, previewing, and saving images.
Update ComfyUI, download the Union ControlNet model to models/controlnet, and then load the workflow.
The listed model files are clip_l.safetensors, FLUX.1-dev-ControlNet-Union-Pro/diffusion_pytorch_model.safetensors, flux1-dev-fp8.safetensors, and t5xxl_fp8_e4m3fn.safetensors.
Named nodes include BasicGuider, BasicScheduler, CLIPTextEncode, ControlNetApplySD3, ControlNetLoader, DualCLIPLoader, EmptySD3LatentImage, FluxGuidance, KSamplerSelect, and LoadImage.
Other named nodes include ModelSamplingFlux, OpenposePreprocessor, PreviewImage, RandomNoise, SamplerCustomAdvanced, SaveImage, SetUnionControlNetType, UNETLoader, VAEDecode, and VAELoader.
In SetUnionControlNetType, map canny to openpose, tile to depth, depth to hed/pidi/scribble/ted, and blur to canny/lineart/anime_lineart/mlsd.
Map pose to normal, gray to segment, and low quality to tile in SetUnionControlNetType.
To tune the stated control influence, adjust strength and end_percent in ControlNetApply; the sample values are 0.4 and 0.6, and the stated strength range is 0.3–0.8.
Sugerencia · sin verificar
Before running, confirm that your ComfyUI setup includes the named nodes used by the workflow.
Sugerencia · sin verificar
¿Es necesario editarlo?
Inicia sesión para solicitar una edición.
Fuentes
1 fuenteExtractos de fuentes
2 extractosSource context: 11947 downloads · Type Workflows · Base model Flux.1 D
tile - "depth"
depth - "hed/pidi/scribble/ted"
blur - "canny/lineart/anime_lineart/mlsd"
pose - "normal"
gray - "segment"
low quality - "tile"
So for example, to use the depth mode you would choose "hed/pidi/scribble/ted" in the SetUnionControlNetType node.
Adjust the strength and end_percent in the ControlNetApply node to find a suitable amount of influence. The sample values in the workflow (0.4 and 0.6) are quite gentle, you may want to increase them to have a stronger influence on the image. The model developer has given a recommended range of 0.3-0.8 for strength.
The archive also contains the openpose image used to generate the example image and the original photo the pose was extracted from.
Optional: if you want to extract input information from your own images, install the "ControlNet Auxiliary Preprocessors" custom node. For openpose you can then enable the openpose extractor node (ctrl+b or right click -> Bypass). Auxiliary preprocessors also include extractors for other modes such as depth and canny which you can put in place of the openpose image (remember to set the correct mode afterwards).
Requisito de VRAM estimado
Estimación no disponible
16,3 GB en 3 de 7 archivos de modelos. Total de archivos de modelos + 25 % de sobrecarga de carga + 2 GB de margen de ejecución, redondeado hacia arriba.
Requisitos
24 requisitosText encoder · 235 MB · SAFETENSORS · Unknown
DualCLIPLoader
No resueltoText encoder · Unknown
ControlNet · Hugging Face · FLUX.1-dev-ControlNet-Union-Pro/diffusion_pytorch_model.safetensors
Checkpoint · 11.5 GB · SAFETENSORS · Unknown
Text encoder · 4.56 GB · SAFETENSOR · fp8 · Unknown
VAEDecode
No resueltoVAE · Unknown
VAELoader
No resueltoVAE · Unknown
BasicGuider
No resueltoPaquete de nodos · Unknown
BasicScheduler
No resueltoPaquete de nodos · Unknown
CLIPTextEncode
No resueltoPaquete de nodos · Unknown
Source context: 11943 downloads · Type Workflows · Base model Flux.1 D
Paquete de nodos · Unknown
ControlNetLoader
No resueltoPaquete de nodos · Unknown
EmptySD3LatentImage
No resueltoPaquete de nodos · Unknown
FluxGuidance
No resueltoPaquete de nodos · Unknown
KSamplerSelect
No resueltoPaquete de nodos · Unknown
LoadImage
No resueltoPaquete de nodos · Unknown
ModelSamplingFlux
No resueltoPaquete de nodos · Unknown
OpenposePreprocessor
No resueltoPaquete de nodos · Unknown
PreviewImage
No resueltoPaquete de nodos · Unknown
RandomNoise
No resueltoPaquete de nodos · Unknown
SamplerCustomAdvanced
No resueltoPaquete de nodos · Unknown
SaveImage
No resueltoPaquete de nodos · Unknown
SetUnionControlNetType
No resueltoPaquete de nodos · Unknown
UNETLoader
No resueltoPaquete de nodos · Unknown