ComfyUI_densediffusion

Update

2024/12/27 Changed to allow multiple masks to be entered in batches.

2024/12/26 If there is no mask input, a solid mask is used instead.

ComfyUI_densediffusion

DenseDiffusion custom node for ComfyUI. Implements the DenseDiffusion-like method for regional prompt used in Omost project.

What this repo implements

Normal attention calculation can be written as y=softmax(q@k)@v. DenseDiffusion introduces the method of attention manipulation on q@k, which makes the expression look like y=softmax(modify(q@k))@v. The original DenseDiffusion's implementation does not perform very well according to my testing so here I only implemented the version used in Omost repo. Refer to https://github.com/lllyasviel/Omost#regional-prompter for other regional prompt methods.

How to use

image

Limitation [IMPORTANT]

Currently ComfyUI's attention replacements do not compose with each other, so this regional prompt method does not compose with IPAdapter. I am currently working on a universal model patcher to solve this issue.