Loading
Have a ComfyUI workflow? Get a readable Workflow Doc in your browser.Make a workflow readable.Try it now ↗
🔮 Transform Your Images with Natural Language Instructions
Runtime profile
Source description
🔮 Transform Your Images with Natural Language Instructions
The Perfect Companion for Seamless Editing
This guide outlines a complete workflow using FluxFill-Dev with ICEdit-MoE-LoRA for powerful natural language-based image editing.
📝 Overview: The Future of Image Editing is Here
ICEdit-MoE-LoRA represents a breakthrough in AI image editing - a lightweight Low-Rank Adaptation (LoRA) module that brings professional-grade, instruction-based editing capabilities to large diffusion transformers. By intelligently fine-tuning only 1% of parameters using just 0.5% of the original training data, it achieves extraordinary editing capabilities that match or even surpass premium commercial solutions.
AI-generated commentary
AI-generated explanation based on source and configuration details. Suggestions are clearly labeled.
ICEdit-workflow is for editing an image with natural-language instructions: it can add, remove, replace, recolor, restyle, or relight content, taking an input image and edit instruction and producing an edited image for preview and saving.
The workflow combines FluxFill-Dev with ICEdit-MoE-LoRA for instruction-based image editing.
The graph includes image loading, inpainting conditioning, sampling, preview, saving, scaling, and model-based upscaling stages.
A Gemini auto-prompt node and LEOPARD, Bernoulli, and SPEED_Q8 are listed as diffusion-model options.
Start with an image and a written instruction, such as adding a castle, changing a car’s color, replacing a person with a tree, applying watercolor style, or adding sunset lighting.
The workflow includes preview, saved-image, scaling, and model-based upscaling stages for its edited image output.
Place model files in ComfyUI’s diffusion_models, text_encoders, vae, and lora folders; ae.safetensors is described as included in the FluxFill package.
The listed model files are ae.safetensors, clip_l_hidream.safetensors, flux1-dev.safetensors, ICEdit-MoE-LoRA.safetensors, t5xxl_fp8_e4m3fn_scaled.safetensors, q5km-fill.gguf, q6_K.gguf, general/4x-UltraSharp.pth, and RealESRGAN_x4plus.pth.
The listed ComfyUI node packs are ComfyUI_Comfyroll_CustomNodes, comfyui_essentials, comfyui-custom-scripts, comfyui-easy-use, ComfyUI-GGUF, comfyui-ollamagemini, rgthree-comfy, and wavespeed.
Choose one T5XXL text encoder based on your hardware: t5xxl_fp16.safetensors, t5xxl_fp8_e4m3fn.safetensors, or t5xxl_fp8_e4m3fn_scaled.safetensors.
Use fluxfill-dev.safetensors as the core editing model, with LEOPARD.gguf, Bernoulli.gguf, or SPEED_Q8.gguf listed as alternatives.
For a starting configuration, try 4–8 steps; the guide assigns flux-dev-fill to editing and flux-dev to enhancing results.
Suggestion
Before setup, verify the availability and exact filenames of ae.safetensors, q5km-fill.gguf, q6_K.gguf, general/4x-UltraSharp.pth, and RealESRGAN_x4plus.pth.
Suggestion · not verified
Also verify the availability and exact names of clip_l_hidream.safetensors, ICEdit-MoE-LoRA.safetensors, t5xxl_fp8_e4m3fn_scaled.safetensors, ComfyUI-GGUF, and wavespeed before setup.
Suggestion · not verified
Does this need to be edited?
Sign in to send an edit request.
Sources
1 sourceSource excerpts
2 excerptsSource context: 1192 downloads · Type Workflows · Base model Flux.1 D
📌 Complete Workflow
This workflow combines FluxFill + ICEdit-MoE-LoRA for editing images with natural language instructions. For enhanced results, diffusion models like LEOPARD , Bernoulli or SPEED_Q8 with the Gemini auto prompt node in 4-8 steps.(i used very light flux model which need less steps)
A diptych with two side-by-side images of the same scene. On the right, the scene is the same as on the left but "your edit"( prostyle included just put ur edit )
🛠️ Complete Installation Guide
📁 Setup Structure
📂 ComfyUI/ ├── 📂 models/ │ ├── 📂 diffusion_models/ │ │ ├── (basic)📄 fluxfill-dev.safetensors # https://civitai.com/models/1108146/fluxfill-devgguf │ │ ├──(option1)📄 LEOPARD.gguf # https://civitai.com/models/1534861 │ │ ├──(option2)📄 Bernoulli.gguf # https://civitai.com/models/682369 │ │ └──(option3)📄 SPEED_Q8.gguf # https://civitai.com/models/661102/speedq8 │ ├── 📂 text_encoders/ │ │ ├── (basic)📄 clip_l.safetensors │ │ ├── (option1)📄 t5xxl_fp16.safetensors │ │ ├── (option2)📄 t5xxl_fp8_e4m3fn.safetensors │ │ └── (option3)📄 t5xxl_fp8_e4m3fn_scaled.safetensors │ ├── 📂 vae/ │ │ └── 📄 ae.safetensors │ └── 📂 lora/ │ └── 📄 ICEdit-MoE.safetensors
💎 Essential Components
✨ LoRA Models - The Magic Touch
ICEdit-MoE.safetensors - The star of the show!
🔤 Text Encoders - The Brain Behind Natural Language Understanding
Note: You only need to choose ONE of the T5XXL options below based on your hardware capabilities
clip_l.safetensors - Core understanding model
T5XXL Options (choose only one):
t5xxl_fp16.safetensors - Highest quality, more demanding
t5xxl_fp8_e4m3fn.safetensors - Balanced performance
t5xxl_fp8_e4m3fn_scaled.safetensors - Optimized for speed
🎭 VAE - The Visual Artist
ae.safetensors - Included in the FluxFill package
🖼️ Diffusion Models - The Imaging Engine
fluxfill-dev.safetensors - Core diffusion model for editing
##(You only need to choose ONE of those or use flux-dev itself its up to u)
LEOPARD.safetensors - Advanced diffusion model for refined outputs
Bernoulli.safetensors - Alternative diffusion model for enhanced generation
SPEED_Q8.gguf - Enhanced flux-dev model for improved results
Note: Any of these diffusion models can be used for efficient editing with fewer steps (4-8 steps recommended). Use flux-dev-fill for editing and flux-dev for enhancing results.
🎬 Example Instructions You Can Try
"Add a majestic castle on the mountain in the background"
"Change the color of the car from red to electric blue"
"Remove the person from the image and replace with a flowering tree"
"Transform the style to watercolor painting while maintaining all details"
"Add dramatic sunset lighting to the scene"
👨💻 Developer Information
This workflow guide was created by Abdallah Al-Swaiti:
LinkedIn Profile
GitHub
Hugging Face
For additional tools and updates, check out the OllamaGemini Node: GitHub Repository
🙏 Community Recognition
A special thank you to sanaka87 for revolutionizing open-source image editing by releasing the ICEdit-MoE-LoRA checkpoint and demos. Your contribution empowers creators everywhere and accelerates innovation across the AI art community!
Remaining hardware or download-size estimates are not available yet.
Requirements
ae.safetensors
FoundVAE · 320 MB · SAFETENSORS · Unknown
Text encoder · 236 MB · SAFETENSORS · Unknown
Source context: 1191 downloads · Type Workflows · Base model Flux.1 D
Checkpoint · 22.2 GB · SAFETENSORS · fp32 · full · Unknown
Upscaler · 63.9 MB · PTH · Hugging Face · general/4x-UltraSharp.pth
ICEdit-MoE-LoRA.safetensors
Not resolvedLoRA · Unknown
q5km-fill.gguf
Not resolvedCheckpoint · Unknown
q6_K.gguf
Not resolvedCheckpoint · Unknown
Upscaler · 63.9 MB · PTH · GitHub · xinntao/Real-ESRGAN
Text encoder · 4.80 GB · SAFETENSORS · fp8 · pruned · Unknown
ComfyUI_Comfyroll_CustomNodes
FoundNode pack · Registry
Node pack · Registry
comfyui-custom-scripts
FoundNode pack · Registry
comfyui-easy-use
FoundNode pack · Registry
ComfyUI-GGUF
PossibleNode pack · Registry
comfyui-ollamagemini
FoundNode pack · Registry
rgthree-comfy
FoundNode pack · Registry
wavespeed
Not resolvedNode pack · Registry
