¿Tienes un flujo de trabajo de ComfyUI? Obtén un Workflow Doc legible en tu navegador.Haz legible un flujo de trabajo.Pruébalo ahora ↗
This workflow uses the Flux Upscale Controlnet ( ) to upscale a provided image. Florence 2 is used to caption the image for automatic prompting.
Perfil de ejecución
Descripción de la fuente
This workflow uses the Flux Upscale Controlnet ( https://huggingface.co/jasperai/Flux.1-dev-Controlnet-Upscaler ) to upscale a provided image. Florence 2 is used to caption the image for automatic prompting.
A script by Kijai ( https://huggingface.co/Kijai/flux-fp8/discussions/7#66ae0455a20def3de3c6d476 ) is used to convert the controlnet to fp8 so that Flux (fp8) and the controlnet can fit into 16GB of VRAM.
Important Notes for the Workflow
Comentario generado por IA
Explicación generada por IA basada en los detalles de la fuente y la configuración. Las sugerencias están claramente identificadas.
Flux Controlnet Upscale is a Flux.1 D workflow for upscaling a provided image: it uses Flux Upscale Controlnet and Florence 2, which captions the image for automatic prompting, and produces an upscaled image.
Input: a provided image. Output: an upscaled image.
The output image size follows the input image’s aspect ratio and the value in the Scale To Megapixels node.
Install Flux VAE with the manager before use.
Sugerencia · sin verificar
The FP8 ControlNet conversion is intended to let Flux FP8 and the ControlNet fit within 16 GB of VRAM.
Named model files include ae.safetensors; flux1-dev-fp8-e4m3fb.safetensors; flux1-dev-fp8-e4m3fn.safetensors; Flux.1-dev-Controlnet-Upscaler_fp8.safetensors; t5xxl_fp8_e4m3fn_scaled.safetensors; and ViT-L-14-BEST-smooth-GmP-TE-only-HF-format.safetensors.
Other named models are Flux.1-dev-Controlnet-Upscaler, Flux VAE, and microsoft/Florence-2-base.
Named workflow nodes include CLIPTextEncode; ColorMatch; ConditioningZeroOut; ControlNetApplyAdvanced; ControlNetLoader; Display Any (rgthree); DownloadAndLoadFlorence2Model; DualCLIPLoader; EmptyLatentImage; Florence2Run; FluxGuidance; GetImageSizeAndCount; ImageScaleToMegapixel
Set Scale To Megapixels between 1 and 2; output size follows this setting and the input image’s aspect ratio.
Sugerencia · sin verificar
Set ControlNet strength between 0.5 and 0.6.
Sugerencia · sin verificar
Use end_percent to adjust fidelity: higher values keep the upscale closer to the original, while lower values leave more room for model creativity.
Sugerencia · sin verificar
For an image that is not a photo, bypass the Text Find and Replace node.
Sugerencia · sin verificar
¿Es necesario editarlo?
Inicia sesión para solicitar una edición.
Fuentes
1 fuenteExtractos de fuentes
1 extractoSource context: 4330 downloads · Type Workflows · Base model Flux.1 D
You should bypass the "Text Find and Replace" node if you are not upscaling a photo.
The size of the output image is controlled by the aspect ratio of the input image and the number of megapixels in the "Scale To Megapixels" node. Set this value between 1 - 2 for the best results.
Strength of the controlnet should be between 0.5 - 0.6
The end_percent can be used to control how faithful the upscale is to the provided image. Higher values to be more faithful to the original image and lower values to give the model more room for creativity.
axior from reddit reported good results with the flux + upscale controlnet method for upscaling to 8megapixels, Controlnet strength 0.85, up until 0.85 of generation, denoise 0.95
Models
flux1-dev-fp8-e4m3fb.safetensors (models/diffusion_models/flux): https://huggingface.co/Kijai/flux-fp8/tree/main
t5xxl_fp8_e4m3fn_scaled.safetensors (models/clip): https://huggingface.co/comfyanonymous/flux_text_encoders/tree/main
ViT-L-14-BEST-smooth-GmP-TE-only-HF-format.safetensors (models/clip): https://huggingface.co/zer0int/CLIP-GmP-ViT-L-14/tree/main
Flux.1-dev-Controlnet-Upscaler (models/controlnet): https://huggingface.co/jasperai/Flux.1-dev-Controlnet-Upscaler converted to fp8 using script by Kijai ( https://huggingface.co/Kijai/flux-fp8/discussions/7#66ae0455a20def3de3c6d476 ) for 16GB VRAM users.
Flux VAE: install with manager
Custom Nodes
ComfyUI-Florence2 by Kijai
WAS Node Suite
comfyui-art-venture
rgthree's ComfyUI Nodes
KJNodes for ComfyUI
Requisito de VRAM estimado
Estimación no disponible
320 MB en 1 de 9 archivos de modelos. Total de archivos de modelos + 25 % de sobrecarga de carga + 2 GB de margen de ejecución, redondeado hacia arriba.
Requisitos
27 requisitosae.safetensors
EncontradoVAE · 320 MB · SAFETENSORS · Unknown
DualCLIPLoader
PosibleText encoder · Unknown
Flux.1-dev-Controlnet-Upscaler_fp8.safetensors
No resueltoUpscaler · Unknown
flux1-dev-fp8-e4m3fn.safetensors
Archivo sin verificarCheckpoint · Unknown · SHA-256 47d8dbdc6da6
Vision model · Hugging Face · microsoft/Florence-2-base
t5xxl_fp8_e4m3fn_scaled.safetensors
Archivo sin verificarText encoder · Unknown
VAEDecode
PosibleVAE · Unknown
VAELoader
PosibleVAE · Unknown
ViT-L-14-BEST-smooth-GmP-TE-only-HF-format.safetensors
No resueltoText encoder · Unknown
CLIPTextEncode
PosiblePaquete de nodos · Unknown
ColorMatch
PosiblePaquete de nodos · Unknown
ConditioningZeroOut
PosiblePaquete de nodos · Unknown
Paquete de nodos · Unknown
ControlNetLoader
PosiblePaquete de nodos · Unknown
Display Any (rgthree)
No resueltoPaquete de nodos · Unknown
DownloadAndLoadFlorence2Model
PosiblePaquete de nodos · Unknown
EmptyLatentImage
PosiblePaquete de nodos · Unknown
Florence2Run
PosiblePaquete de nodos · Unknown
FluxGuidance
No resueltoPaquete de nodos · Unknown
GetImageSizeAndCount
PosiblePaquete de nodos · Unknown
Paquete de nodos · Unknown
KSampler
PosiblePaquete de nodos · Unknown
LoadImage
PosiblePaquete de nodos · Unknown
SaveImage
PosiblePaquete de nodos · Unknown
Paquete de nodos · Unknown
TorchCompileModel
No resueltoPaquete de nodos · Unknown
UNETLoader
PosiblePaquete de nodos · Unknown
