This workflow uses the Flux Upscale Controlnet ( ) to upscale a provided image. Florence 2 is used to caption the image for automatic prompting.
Laufzeitprofil
Quellenbeschreibung
This workflow uses the Flux Upscale Controlnet ( https://huggingface.co/jasperai/Flux.1-dev-Controlnet-Upscaler ) to upscale a provided image. Florence 2 is used to caption the image for automatic prompting.
A script by Kijai ( https://huggingface.co/Kijai/flux-fp8/discussions/7#66ae0455a20def3de3c6d476 ) is used to convert the controlnet to fp8 so that Flux (fp8) and the controlnet can fit into 16GB of VRAM.
Important Notes for the Workflow
KI-generierter Kommentar
KI-generierte Erklärung auf Grundlage von Quellen- und Konfigurationsdetails. Vorschläge sind klar gekennzeichnet.
Flux Controlnet Upscale is a Flux.1 D workflow for upscaling a provided image: it uses Flux Upscale Controlnet and Florence 2, which captions the image for automatic prompting, and produces an upscaled image.
Input: a provided image. Output: an upscaled image.
The output image size follows the input image’s aspect ratio and the value in the Scale To Megapixels node.
Install Flux VAE with the manager before use.
Vorschlag · nicht geprüft
The FP8 ControlNet conversion is intended to let Flux FP8 and the ControlNet fit within 16 GB of VRAM.
Named model files include ae.safetensors; flux1-dev-fp8-e4m3fb.safetensors; flux1-dev-fp8-e4m3fn.safetensors; Flux.1-dev-Controlnet-Upscaler_fp8.safetensors; t5xxl_fp8_e4m3fn_scaled.safetensors; and ViT-L-14-BEST-smooth-GmP-TE-only-HF-format.safetensors.
Other named models are Flux.1-dev-Controlnet-Upscaler, Flux VAE, and microsoft/Florence-2-base.
Named workflow nodes include CLIPTextEncode; ColorMatch; ConditioningZeroOut; ControlNetApplyAdvanced; ControlNetLoader; Display Any (rgthree); DownloadAndLoadFlorence2Model; DualCLIPLoader; EmptyLatentImage; Florence2Run; FluxGuidance; GetImageSizeAndCount; ImageScaleToMegapixel
Set Scale To Megapixels between 1 and 2; output size follows this setting and the input image’s aspect ratio.
Vorschlag · nicht geprüft
Set ControlNet strength between 0.5 and 0.6.
Vorschlag · nicht geprüft
Use end_percent to adjust fidelity: higher values keep the upscale closer to the original, while lower values leave more room for model creativity.
Vorschlag · nicht geprüft
For an image that is not a photo, bypass the Text Find and Replace node.
Vorschlag · nicht geprüft
Muss das bearbeitet werden?
Melden Sie sich an, um eine Änderungsanfrage zu senden.
Quellen
1 QuelleQuellenauszüge
1 AuszugSource context: 4330 downloads · Type Workflows · Base model Flux.1 D
You should bypass the "Text Find and Replace" node if you are not upscaling a photo.
The size of the output image is controlled by the aspect ratio of the input image and the number of megapixels in the "Scale To Megapixels" node. Set this value between 1 - 2 for the best results.
Strength of the controlnet should be between 0.5 - 0.6
The end_percent can be used to control how faithful the upscale is to the provided image. Higher values to be more faithful to the original image and lower values to give the model more room for creativity.
axior from reddit reported good results with the flux + upscale controlnet method for upscaling to 8megapixels, Controlnet strength 0.85, up until 0.85 of generation, denoise 0.95
Models
flux1-dev-fp8-e4m3fb.safetensors (models/diffusion_models/flux): https://huggingface.co/Kijai/flux-fp8/tree/main
t5xxl_fp8_e4m3fn_scaled.safetensors (models/clip): https://huggingface.co/comfyanonymous/flux_text_encoders/tree/main
ViT-L-14-BEST-smooth-GmP-TE-only-HF-format.safetensors (models/clip): https://huggingface.co/zer0int/CLIP-GmP-ViT-L-14/tree/main
Flux.1-dev-Controlnet-Upscaler (models/controlnet): https://huggingface.co/jasperai/Flux.1-dev-Controlnet-Upscaler converted to fp8 using script by Kijai ( https://huggingface.co/Kijai/flux-fp8/discussions/7#66ae0455a20def3de3c6d476 ) for 16GB VRAM users.
Flux VAE: install with manager
Custom Nodes
ComfyUI-Florence2 by Kijai
WAS Node Suite
comfyui-art-venture
rgthree's ComfyUI Nodes
KJNodes for ComfyUI
Geschätzter VRAM Bedarf
Schätzung nicht verfügbar
320 MB über 1 von 9 Modell-Dateien. Gesamtmodell-Dateien + 25% Ladeaufwand + 2 GB Ausführungs-Puffer, aufgerundet.
Anforderungen
27 Anforderungenae.safetensors
GefundenVAE · 320 MB · SAFETENSORS · Unknown
DualCLIPLoader
MöglichText encoder · Unknown
Flux.1-dev-Controlnet-Upscaler_fp8.safetensors
Nicht aufgelöstUpscaler · Unknown
flux1-dev-fp8-e4m3fn.safetensors
Datei ungeprüftCheckpoint · Unknown · SHA-256 47d8dbdc6da6
Vision model · Hugging Face · microsoft/Florence-2-base
t5xxl_fp8_e4m3fn_scaled.safetensors
Datei ungeprüftText encoder · Unknown
VAEDecode
MöglichVAE · Unknown
VAELoader
MöglichVAE · Unknown
ViT-L-14-BEST-smooth-GmP-TE-only-HF-format.safetensors
Nicht aufgelöstText encoder · Unknown
CLIPTextEncode
MöglichKnotenpaket · Unknown
ColorMatch
MöglichKnotenpaket · Unknown
ConditioningZeroOut
MöglichKnotenpaket · Unknown
ControlNetApplyAdvanced
Knotenpaket · Unknown
ControlNetLoader
MöglichKnotenpaket · Unknown
Display Any (rgthree)
Nicht aufgelöstKnotenpaket · Unknown
DownloadAndLoadFlorence2Model
MöglichKnotenpaket · Unknown
EmptyLatentImage
MöglichKnotenpaket · Unknown
Florence2Run
MöglichKnotenpaket · Unknown
FluxGuidance
Nicht aufgelöstKnotenpaket · Unknown
GetImageSizeAndCount
MöglichKnotenpaket · Unknown
Knotenpaket · Unknown
KSampler
MöglichKnotenpaket · Unknown
LoadImage
MöglichKnotenpaket · Unknown
SaveImage
MöglichKnotenpaket · Unknown
Knotenpaket · Unknown
TorchCompileModel
Nicht aufgelöstKnotenpaket · Unknown
UNETLoader
MöglichKnotenpaket · Unknown