Skip to content
Node packVerifiedExternal
Open source

ComfyUI_NetDist_Plus

Run ComfyUI workflows on multiple local GPUs/networked machines.

Maintainer@nux1111Unratedgrade

Package profile

Status
Verified
Publisher
@nux1111
Source
GitHub

README

ComfyUI_NetDist Plus

Run ComfyUI workflows on multiple local GPUs/networked machines with options to edit the json values within comfyui.

Credits

Comfyanonymous; for obvious reasons City96; without the base netdist repo, I wouldn't have attempted this. EventStationAI; for some GPU support. All node creators that I used their work in some ways in the creation of the workflows or code snippets. (Easy Use, Ipadapter_Plus, CR) Claude; what do I do next? Can you debug this error? Ogkai; Thanks for encouraging me to start pushing stuffs I make or modify. *On twitter(X) if you have questions :)

Issues

*Remote Latents: I didn't get a chance to test it. *Batched Base64 images: There are existing node that should fix that. *Batch size > 1 for STYLE TRANSFER: Didn't take note of the errors I got but that needs some work.

Note: I am a primitive coder and I know very little about github. Bear with me if issues arise. Of course collabs are awesome. The listed examples were done on a 4090 host and 3080ti remote pc.

Remote conditioning Workflow

The use case for this is running T5 and clip L on a different comfy instance so the primary PC can focus on running UNET and VAE.

REMOTE_CLIP_OFFSET

Remote Batch Workflow with different checkpoints

This workflow is useful for comparing Flux Dev and Schnell models. Since the remote pc runs the Schnell, it is bearable.

REMOTE_BATCH

Style Transfer Example

This uses a remote pc to run a SDXL ipadapter style transfer pipe.

REMOTE_STYLETRANSFER

Making remote conds

REMOTE_conds

NetDist_2xspeed.webm

Install instructions:

There is currently a single external requirement, which is the requests library.

pip install requests

To install, simply clone into the custom nodes folder.

git clone https://github.com/city96/ComfyUI_NetDist ComfyUI/custom_nodes/ComfyUI_NetDist

Usage

Local Remote control

You will need at least two different ComfyUI instances. You can use two local GPUs by setting different --port [port] and --cuda-device [number] launch arguments. You'll most likely want --port 8288 --cuda-device 1

Simple dual-GPU

This is the simplest setup for people who have 2 GPUs or two separate PCs. It only requires two nodes to work.

You can set the local/remote batch size, as well as when the node should trigger (set it to 'always' if it isn't getting executed - i.e. you changed a sampler setting but not the seed.)

If you're running your second instance on a different PC, add --listen to your launch arguments and set the correct remote IP (open a terminal window and check with ipconfig on windows or ip a on linux).

The FetchRemote ('Fetch from remote') node takes an image input. This should be your final image than you want to get back from your second instance (make sure not to route it back into itself). This node will wait for the second image to be generated (there's currently no preview/progress bar).

Workflow JSON: NetDistSimple.json

NetDistSimple

Simple multi-machine

You can kind of

Nodes in this pack

27 nodes
  • CombineImageBatch
  • ConditioningFromBase64(Nux)
  • ConditioningToBase64(Nux)
  • ExtractBase64FromImage(Nux)
  • ExtractBase64FromImageUpload(Nux)
  • FetchRemote
  • FetchRemoteWithExtras(Nux)
  • LatentToBase64(Nux)
  • LoadCurrentWorkflowJSON
  • LoadDiskWorkflowJSON
  • LoadImageUrl
  • LoadLatentFromBase64(Nux)
  • LoadLatentNumpy
  • LoadLatentUrl
  • LoadWorkflowJSON
  • RemoteApplyValues(Nux)
  • RemoteApplyValuesMulti(Nux)
  • RemoteChainEnd
  • RemoteChainStart
  • RemoteChainStart(Nux)
  • RemoteQueueSimple
  • RemoteQueueSimple(Nux)
  • RemoteQueueWorker
  • SaveDiskWorkflowJSON
  • SaveImageUrl
  • SaveImageWithBase64(Nux)
  • SaveLatentNumpy

Sources

3 sources
GitHubSource
github.com/nux1111/ComfyUI_NetDist_Plus

Verified Oct 3

GitHubSourceVersion 90f61354aba480217780f28b145a2356b30ff672
github.com/nux1111/ComfyUI_NetDist_Plus

Verified Oct 3

Source excerpts

1 excerpt

Source context: Repo nux1111/ComfyUI_NetDist_Plus