Skip to content
Node packVerifiedExternal
Open source

comfyui_controlnet_aux

ComfyUI's ControlNet Auxiliary Preprocessors

Maintainer@Fannovel16Cgrade

Package profile

Status
Verified
Publisher
@Fannovel16
Source
GitHub
Stars
4.1K
Linked pipes
1

README

ComfyUI's ControlNet Auxiliary Preprocessors

Plug-and-play ComfyUI node sets for making ControlNet hint images

"anime style, a protest in the street, cyberpunk city, a woman with pink hair and golden eyes (looking at the viewer) is holding a sign with the text "ComfyUI ControlNet Aux" in bold, neon pink" on Flux.1 Dev

The code is copy-pasted from the respective folders in https://github.com/lllyasviel/ControlNet/tree/main/annotator and connected to the 🤗 Hub.

All credit & copyright goes to https://github.com/lllyasviel.

Updates

Go to Update page to follow updates

Installation:

Using ComfyUI Manager (recommended):

Install ComfyUI Manager and do steps introduced there to install this repo.

Alternative:

If you're running on Linux, or non-admin account on windows you'll want to ensure /ComfyUI/custom_nodes and comfyui_controlnet_aux has write permissions.

There is now a install.bat you can run to install to portable if detected. Otherwise it will default to system and assume you followed ConfyUI's manual installation steps.

If you can't run install.bat (e.g. you are a Linux user). Open the CMD/Shell and do the following:

  • Navigate to your /ComfyUI/custom_nodes/ folder
  • Run git clone https://github.com/Fannovel16/comfyui_controlnet_aux/
  • Navigate to your comfyui_controlnet_aux folder
    • Portable/venv:
      • Run path/to/ComfUI/python_embeded/python.exe -s -m pip install -r requirements.txt
    • With system python
      • Run pip install -r requirements.txt
  • Start ComfyUI

Nodes

Please note that this repo only supports preprocessors making hint images (e.g. stickman, canny edge, etc). All preprocessors except Inpaint are intergrated into AIO Aux Preprocessor node. This node allow you to quickly get the preprocessor but a preprocessor's own threshold parameters won't be able to set. You need to use its node directly to set thresholds.

Nodes (sections are categories in Comfy menu)

Line Extractors

Preprocessor Nodesd-webui-controlnet/otherControlNet/T2I-Adapter
Binary Linesbinarycontrol_scribble
Canny Edgecannycontrol_v11p_sd15_canny control_canny t2iadapter_canny
HED Soft-Edge Lineshedcontrol_v11p_sd15_softedge control_hed
Standard Lineartstandard_lineartcontrol_v11p_sd15_lineart
Realistic Lineartlineart (or lineart_coarse if coarse is enabled)control_v11p_sd15_lineart
Anime Lineartlineart_animecontrol_v11p_sd15s2_lineart_anime
Manga Lineartlineart_anime_denoisecontrol_v11p_sd15s2_lineart_anime
M-LSD Linesmlsdcontrol_v11p_sd15_mlsd control_mlsd
PiDiNet Soft-Edge Linespidinetcontrol_v11p_sd15_softedge control_scribble
Scribble Linesscribblecontrol_v11p_sd15_scribble control_scribble
Scribble XDoG Linesscribble_xdogcontrol_v11p_sd15_scribble control_scribble
Fake Scribble Linesscribble_hedcontrol_v11p_sd15_scribble control_scribble
TEED Soft-Edge Linesteedcontrolnet-sd-xl-1.0-softedge-dexined control_v11p_sd15_soft

Nodes in this pack

66 nodes
  • AIO_Preprocessor
  • AnimalPosePreprocessor
  • AnimeFace_SemSegPreprocessor
  • AnimeLineArtPreprocessor
  • AnyLineArtPreprocessor_aux
  • BAE-NormalMapPreprocessor
  • BinaryPreprocessor
  • CannyEdgePreprocessor
  • ColorPreprocessor
  • ControlNetAuxSimpleAddText
  • ControlNetPreprocessorSelector
  • DensePosePreprocessor
  • DepthAnythingPreprocessor
  • DepthAnythingV2Preprocessor
  • DiffusionEdge_Preprocessor
  • DSINE-NormalMapPreprocessor
  • DWPreprocessor
  • ExecuteAllControlNetPreprocessors
  • FacialPartColoringFromPoseKps
  • FakeScribblePreprocessor
  • HEDPreprocessor
  • HintImageEnchance
  • ImageGenResolutionFromImage
  • ImageGenResolutionFromLatent
  • ImageIntensityDetector
  • ImageLuminanceDetector
  • InpaintPreprocessor
  • LeReS-DepthMapPreprocessor
  • LineArtPreprocessor
  • LineartStandardPreprocessor
  • M-LSDPreprocessor
  • Manga2Anime_LineArt_Preprocessor
  • MaskOptFlow
  • MediaPipe-FaceMeshPreprocessor
  • MeshGraphormer-DepthMapPreprocessor
  • MeshGraphormer+ImpactDetector-DepthMapPreprocessor
  • Metric_DepthAnythingV2Preprocessor
  • Metric3D-DepthMapPreprocessor
  • Metric3D-NormalMapPreprocessor
  • MiDaS-DepthMapPreprocessor
  • MiDaS-NormalMapPreprocessor
  • OneFormer-ADE20K-SemSegPreprocessor
  • OneFormer-COCO-SemSegPreprocessor
  • OpenposePreprocessor
  • PiDiNetPreprocessor
  • PixelPerfectResolution
  • PyraCannyPreprocessor
  • RenderAnimalKps
  • RenderPeopleKps
  • SAMPreprocessor
  • SavePoseKpsAsJsonFile
  • Scribble_PiDiNet_Preprocessor
  • Scribble_XDoG_Preprocessor
  • ScribblePreprocessor
  • SemSegPreprocessor
  • ShufflePreprocessor
  • TEED_Preprocessor
  • TEEDPreprocessor
  • TilePreprocessor
  • TTPlanet_TileGF_Preprocessor
  • TTPlanet_TileSimple_Preprocessor
  • UniFormer-SemSegPreprocessor
  • Unimatch_OptFlowPreprocessor
  • UpperBodyTrackingFromPoseKps
  • Zoe_DepthAnythingPreprocessor
  • Zoe-DepthMapPreprocessor

Related resources

7 connections

Sources

3 sources

Source excerpts

1 excerpt

Source context: Repo Fannovel16/comfyui_controlnet_aux