Loading
Tem um workflow do ComfyUI? Gere uma documentação legível direto no navegador.Torne um workflow legível.Experimentar agora ↗
🔮 Transform Your Images with Natural Language Instructions
Perfil de execução
Descrição da fonte
🔮 Transform Your Images with Natural Language Instructions
The Perfect Companion for Seamless Editing
This guide outlines a complete workflow using FluxFill-Dev with ICEdit-MoE-LoRA for powerful natural language-based image editing.
📝 Overview: The Future of Image Editing is Here
ICEdit-MoE-LoRA represents a breakthrough in AI image editing - a lightweight Low-Rank Adaptation (LoRA) module that brings professional-grade, instruction-based editing capabilities to large diffusion transformers. By intelligently fine-tuning only 1% of parameters using just 0.5% of the original training data, it achieves extraordinary editing capabilities that match or even surpass premium commercial solutions.
Comentário gerado por IA
Explicação gerada por IA com base nos detalhes da fonte e da configuração. As sugestões são claramente identificadas.
ICEdit-workflow is for editing an image with natural-language instructions: it can add, remove, replace, recolor, restyle, or relight content, taking an input image and edit instruction and producing an edited image for preview and saving.
The workflow combines FluxFill-Dev with ICEdit-MoE-LoRA for instruction-based image editing.
The graph includes image loading, inpainting conditioning, sampling, preview, saving, scaling, and model-based upscaling stages.
A Gemini auto-prompt node and LEOPARD, Bernoulli, and SPEED_Q8 are listed as diffusion-model options.
Start with an image and a written instruction, such as adding a castle, changing a car’s color, replacing a person with a tree, applying watercolor style, or adding sunset lighting.
The workflow includes preview, saved-image, scaling, and model-based upscaling stages for its edited image output.
Place model files in ComfyUI’s diffusion_models, text_encoders, vae, and lora folders; ae.safetensors is described as included in the FluxFill package.
The listed model files are ae.safetensors, clip_l_hidream.safetensors, flux1-dev.safetensors, ICEdit-MoE-LoRA.safetensors, t5xxl_fp8_e4m3fn_scaled.safetensors, q5km-fill.gguf, q6_K.gguf, general/4x-UltraSharp.pth, and RealESRGAN_x4plus.pth.
The listed ComfyUI node packs are ComfyUI_Comfyroll_CustomNodes, comfyui_essentials, comfyui-custom-scripts, comfyui-easy-use, ComfyUI-GGUF, comfyui-ollamagemini, rgthree-comfy, and wavespeed.
Choose one T5XXL text encoder based on your hardware: t5xxl_fp16.safetensors, t5xxl_fp8_e4m3fn.safetensors, or t5xxl_fp8_e4m3fn_scaled.safetensors.
Use fluxfill-dev.safetensors as the core editing model, with LEOPARD.gguf, Bernoulli.gguf, or SPEED_Q8.gguf listed as alternatives.
For a starting configuration, try 4–8 steps; the guide assigns flux-dev-fill to editing and flux-dev to enhancing results.
Sugestão
Before setup, verify the availability and exact filenames of ae.safetensors, q5km-fill.gguf, q6_K.gguf, general/4x-UltraSharp.pth, and RealESRGAN_x4plus.pth.
Sugestão · não verificado
Also verify the availability and exact names of clip_l_hidream.safetensors, ICEdit-MoE-LoRA.safetensors, t5xxl_fp8_e4m3fn_scaled.safetensors, ComfyUI-GGUF, and wavespeed before setup.
Sugestão · não verificado
Isso precisa ser editado?
Faça login para enviar uma solicitação de edição.
Fontes
1 fonteTrechos de fonte
2 trechosSource context: 1192 downloads · Type Workflows · Base model Flux.1 D
📌 Complete Workflow
This workflow combines FluxFill + ICEdit-MoE-LoRA for editing images with natural language instructions. For enhanced results, diffusion models like LEOPARD , Bernoulli or SPEED_Q8 with the Gemini auto prompt node in 4-8 steps.(i used very light flux model which need less steps)
A diptych with two side-by-side images of the same scene. On the right, the scene is the same as on the left but "your edit"( prostyle included just put ur edit )
🛠️ Complete Installation Guide
📁 Setup Structure
📂 ComfyUI/ ├── 📂 models/ │ ├── 📂 diffusion_models/ │ │ ├── (basic)📄 fluxfill-dev.safetensors # https://civitai.com/models/1108146/fluxfill-devgguf │ │ ├──(option1)📄 LEOPARD.gguf # https://civitai.com/models/1534861 │ │ ├──(option2)📄 Bernoulli.gguf # https://civitai.com/models/682369 │ │ └──(option3)📄 SPEED_Q8.gguf # https://civitai.com/models/661102/speedq8 │ ├── 📂 text_encoders/ │ │ ├── (basic)📄 clip_l.safetensors │ │ ├── (option1)📄 t5xxl_fp16.safetensors │ │ ├── (option2)📄 t5xxl_fp8_e4m3fn.safetensors │ │ └── (option3)📄 t5xxl_fp8_e4m3fn_scaled.safetensors │ ├── 📂 vae/ │ │ └── 📄 ae.safetensors │ └── 📂 lora/ │ └── 📄 ICEdit-MoE.safetensors
💎 Essential Components
✨ LoRA Models - The Magic Touch
ICEdit-MoE.safetensors - The star of the show!
🔤 Text Encoders - The Brain Behind Natural Language Understanding
Note: You only need to choose ONE of the T5XXL options below based on your hardware capabilities
clip_l.safetensors - Core understanding model
T5XXL Options (choose only one):
t5xxl_fp16.safetensors - Highest quality, more demanding
t5xxl_fp8_e4m3fn.safetensors - Balanced performance
t5xxl_fp8_e4m3fn_scaled.safetensors - Optimized for speed
🎭 VAE - The Visual Artist
ae.safetensors - Included in the FluxFill package
🖼️ Diffusion Models - The Imaging Engine
fluxfill-dev.safetensors - Core diffusion model for editing
##(You only need to choose ONE of those or use flux-dev itself its up to u)
LEOPARD.safetensors - Advanced diffusion model for refined outputs
Bernoulli.safetensors - Alternative diffusion model for enhanced generation
SPEED_Q8.gguf - Enhanced flux-dev model for improved results
Note: Any of these diffusion models can be used for efficient editing with fewer steps (4-8 steps recommended). Use flux-dev-fill for editing and flux-dev for enhancing results.
🎬 Example Instructions You Can Try
"Add a majestic castle on the mountain in the background"
"Change the color of the car from red to electric blue"
"Remove the person from the image and replace with a flowering tree"
"Transform the style to watercolor painting while maintaining all details"
"Add dramatic sunset lighting to the scene"
👨💻 Developer Information
This workflow guide was created by Abdallah Al-Swaiti:
LinkedIn Profile
GitHub
Hugging Face
For additional tools and updates, check out the OllamaGemini Node: GitHub Repository
🙏 Community Recognition
A special thank you to sanaka87 for revolutionizing open-source image editing by releasing the ICEdit-MoE-LoRA checkpoint and demos. Your contribution empowers creators everywhere and accelerates innovation across the AI art community!
Remaining hardware or download-size estimates are not available yet.
Requisitos
ae.safetensors
EncontradoVAE · 320 MB · SAFETENSORS · Unknown
Text encoder · 236 MB · SAFETENSORS · Unknown
Source context: 1191 downloads · Type Workflows · Base model Flux.1 D
Checkpoint · 22.2 GB · SAFETENSORS · fp32 · full · Unknown
Upscaler · 63.9 MB · PTH · Hugging Face · general/4x-UltraSharp.pth
ICEdit-MoE-LoRA.safetensors
Não resolvidoLoRA · Unknown
q5km-fill.gguf
Não resolvidoCheckpoint · Unknown
q6_K.gguf
Não resolvidoCheckpoint · Unknown
Upscaler · 63.9 MB · PTH · GitHub · xinntao/Real-ESRGAN
t5xxl_fp8_e4m3fn_scaled.safetensors
EncontradoText encoder · 4.80 GB · SAFETENSORS · fp8 · pruned · Unknown
ComfyUI_Comfyroll_CustomNodes
EncontradoPacote de nós · Registry
Pacote de nós · Registry
comfyui-custom-scripts
EncontradoPacote de nós · Registry
comfyui-easy-use
EncontradoPacote de nós · Registry
ComfyUI-GGUF
PossívelPacote de nós · Registry
comfyui-ollamagemini
EncontradoPacote de nós · Registry
rgthree-comfy
EncontradoPacote de nós · Registry
wavespeed
Não resolvidoPacote de nós · Registry
