A workflow I made for myself for convenient control over generation.
Runtime profile
Source description
A workflow I made for myself for convenient control over generation.
Working on making a "Control panel", user friendly version later.
Description :
Notes Some notes I prefer to have to sketch down prompts I liked.
Main loader Load Checkpoint, LoRA here, set latent image size. You can loop multiple checkpoints.
Prompting Prompt subject and scene separately (important as ControlNet takes subject prompt, Depth mask uses both for foreground/background), you select styles, make some randomized content (I use 2 random colors as _color , a random animal as _subject and a random location as _location .
AI-generated commentary
AI-generated explanation based on source and configuration details. Suggestions are clearly labeled.
Use this workflow for controlled image generation: load checkpoints and LoRAs, set latent image dimensions, enter separate subject and scene prompts, and load up to three images into IPAdapter to modify style; the first pass generates an image at the latent dimensions, and the第二?
Enter subject and scene prompts separately. ControlNet uses the subject prompt, while Depth mask uses both to create foreground/subject and background/scene masks.
ControlNet creates the basic subject image; Depth mask uses it to split the image into foreground/subject and background/scene masks and applies the corresponding prompts.
The first pass uses the latent dimensions and can set an upscale ratio; the second pass generates the upscaled image for preview or saving.
The Main loader accepts checkpoints and LoRAs, sets the latent image size, and can loop multiple checkpoints.
Prompting supports style selection and randomized content using _color, _subject, and _location; IPAdapter can use three images to modify style.
The listed base model is SDXL 1.0, and the publisher is Yorgash.
Model files listed: add-detail-xl.safetensors, animagineXL40_v4Opt.safetensors, ArtNouveau2SDXL.safetensors, CirnoTouhouIXL.safetensors, CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors, Dark_Ghibli.safetensors, and Dark_realism_anime_style.safetensors.
More model files listed: diffusion_pytorch_model.safetensors, furrytoonmixPony_v10.safetensors, RealESRGAN_x4plus_anime_6B.pth, Rodney_Matthews_Style_SDXL_-_Fantasy_Illustrator-000007.safetensors, and SDXLFaeTastic2400.safetensors.
Node packs listed: bjornulf_custom_nodes, comfyroll, ComfyUI_Comfyroll_CustomNodes, comfyui_controlnet_aux, comfyui-easy-use, comfyui-impact-pack, comfyui_ipadapter_plus, comfyui-rvtools, comfyui_tinyterranodes, ComfyUI-QualityOfLifeSuit_Omar92, kaytool, onebuttonprompt, rgthree,
Use Depth mask and ControlNet together, or disable both.
Suggestion · not verified
Before use, verify that the listed model files are available.
Suggestion · not verified
Before use, verify that the listed node packs are available.
Suggestion · not verified
Does this need to be edited?
Sign in to send an edit request.
Sources
1 sourceSource excerpts
1 excerptSource context: 363 downloads · Type Workflows · Base model SDXL 1.0
Conditioning Sets the base condition for the generation, passes along for other nodes to use it.
Depth mask Depth mask splits the image to two separate masks based on the image generated in ControlNet group: basically a foreground/subject and background/scene masks, then applies the subject / background prompts from Prompting section.
ControlNet Creates the basic image of subject ( Depth mask will use this), then applies itself to the rest of the generating process.
IPAdapter You can load 3 images here that IPAdapter will use to modify the style.
1st pass, 2nd pass, Preview image 1st pass generated the final image with latent's dimensions - you can also set upscale ratio here, 2nd pass generates the upscaled image, and you can then preview / save image.
You can supposedly turn off each component separately besides basic loader, prompting and conditioning, but Depth mask and ControlNet should be used both or neither.
Important: this workflow is not yet optimized to be beginner / user-friendly, I'm planning on releasing one some time later, probably at the weekend, if anyone needs it. Also couldn't cut the number of custom nodes used more than this, but will try to in theoretical later versions. Currently the workflow uses these custom nodes:
comfyui_controlnet_aux ComfyUI Impact Pack ConfyUI_LayerStyle rghtree-comfy ComfyUI-Easy-Use ComfyUI-KJNodes OneButtonPrompt ComfyUI_essentials tinyterraNodes Bjornulf_custom_nodes Quality of life Suit:V2 KayTool ComfyUI-RvTools
From the top left corner: basic conditioning, Depth mask applied by itself, ControlNet applied in addition, IPAdapter also applied.
Remaining hardware or download-size estimates are not available yet.
Requirements
LoRA · 218 MB · SAFETENSORS · Unknown
animagineXL40_v4Opt.safetensors
Not resolvedCheckpoint · Unknown
ArtNouveau2SDXL.safetensors
LoRA · Unknown
CirnoTouhouIXL.safetensors
Not resolvedLoRA · Unknown
CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors
Not resolvedVision model · Unknown
Dark_Ghibli.safetensors
PossibleLoRA · Unknown
Dark_realism_anime_style.safetensors
Not resolvedLoRA · Unknown
diffusion_pytorch_model.safetensors
PossibleControlNet · Unknown
furrytoonmixPony_v10.safetensors
Not resolvedCheckpoint · Unknown
RealESRGAN_x4plus_anime_6B.pth
Not resolvedUpscaler · Unknown
Rodney_Matthews_Style_SDXL_-_Fantasy_Illustrator-000007.safetensors
Not resolvedLoRA · Unknown
SDXLFaeTastic2400.safetensors
Not resolvedLoRA · Unknown
Node pack · Registry
comfyroll
Not resolvedNode pack · Registry
ComfyUI_Comfyroll_CustomNodes
FoundNode pack · Registry
comfyui_controlnet_aux
PossibleNode pack · Registry
Node pack · Registry
comfyui_ipadapter_plus
PossibleNode pack · Registry
comfyui_tinyterranodes
FoundNode pack · Registry
comfyui-easy-use
FoundNode pack · Registry
comfyui-impact-pack
FoundNode pack · Registry
Node pack · Registry
comfyui-rvtools
Not resolvedNode pack · Registry
kaytool
FoundNode pack · Registry
onebuttonprompt
FoundNode pack · Registry
rgthree-comfy
FoundNode pack · Registry
searge
Not resolvedNode pack · Registry