INT4 ConvRot W4A4

--- tags: - comfyui - int4 - convrot - w4a4 - krea2 - qwenimage - fireredimageedit - qwen2_5_vl - qwen3 - qwen3_vl - Quantizations --- For non-INT4 models, go to https://huggingface.co/ariaotp/int8-ComfyUI instead. These models are quantized INT4 Convrot W4A4 for ComfyUI 0.28.0 or later. It has somewhat inferior image quality than BF16/GGUF Q8/INT8 Convrot but fast in Ampere(RTX30x0)/Ada Lovelace(RTX40x0) Original models that I used: * Krea2 Turbo: https://huggingface.co/LAXMAYDAY/Krea-2-Turbo-int4-tensorwise-mixed * Krea2 Raw: https://huggingface.co/LAXMAYDAY/Krea-2-Raw-int4-tensorwise-mixed * Qwen-Image-2512: https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI * Qwen-Image-Edit-2511: https://huggingface.co/LAXMAYDAY/Qwen-Image-Edit-2511-int4-tensorwise-mixed * FireRed-Image-Edit 1.1: https://huggingface.co/cocorang/FireRed-Image-Edit-1.1-FP8_And_BF16 * FLUX.2 Klein 9B: https://huggingface.co/black-forest-labs/FLUX.2-klein-9B * Qwen2.5-VL 7B (Qwen2.5-VL-7B-Instruct-abliterated): https://huggingface.co/huihui-ai/Qwen2.5-VL-7B-Instruct-abliterated (Needed for Qwen-Image and FireRed-Image-Edit) * Qwen3 4B (Huihui-Qwen3-4B-abliterated-v2): https://huggingface.co/chinmankokumin/Qwen3-4B-abliterated-v2 (Needed for Z-Image and FLUX.2 Klein 4B) * Qwen3 8B (Huihui-Qwen3-8B-abliterated-v2): https://huggingface.co/huihui-ai/Huihui-Qwen3-8B-abliterated-v2 (Needed for FLUX.2 Klein 9B) * Qwen3-VL 4B (Huihui-Qwen3-VL-4B-Instruct-abliterated): https://huggingface.co/ahmed22xa/Huihui-Qwen3-VL-4B-Instruct-abliterated-comfy (Needed for Krea2) * Qwen3-VL 8B (Huihui-Qwen3-VL-8B-Instruct-abliterated): https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated (Needed for Boogu-Image and Ideogram4) For Krea2 models and Qwen-Image-Edit 2511, Since they are already quantized INT4 ConvRot W4A4 by LAXMAYDAY, I fixed keys of those models to convrot_w4a4 for working on official ComfyUI. That python script I created used ChatGPT 5.6 Sol is convert_int4_tensorwise_to_convrot_w4a4.py. The rest of them are used Starnodes Model Converter, made by Starnodes2024, quantized from BF16 models https://github.com/Starnodes2024/comfyui-starnodes-modelconverter Or quant_int8_convrot.py of ComfyUI's official ComfyUI model tools https://github.com/Comfy-Org/comfy-model-tools convert_int4_tensorwise_to_convrot_w4a4.py Script usage (not so useful because I already conv...

--- tags: - comfyui - int4 - convrot - w4a4 - krea2 - qwenimage - fireredimageedit - qwen2_5_vl - qwen3 - qwen3_vl - Quantizations --- For non-INT4 models, go to https://huggingface.co/ariaotp/int8-ComfyUI instead. These models are quantized INT4 Convrot W4A4 for ComfyUI 0.28.0 or later. It has somewhat inferior image quality than BF16/GGUF Q8/INT8 Convrot but fast in Ampere(RTX30x0)/Ada Lovelace(RTX40x0) Original models that I used: * Krea2 Turbo: https://huggingface.co/LAXMAYDAY/Krea-2-Turbo-int4-tensorwise-mixed * Krea2 Raw: https://huggingface.co/LAXMAYDAY/Krea-2-Raw-int4-tensorwise-mixed * Qwen-Image-2512: https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI * Qwen-Image-Edit-2511: https://huggingface.co/LAXMAYDAY/Qwen-Image-Edit-2511-int4-tensorwise-mixed * FireRed-Image-Edit 1.1: https://huggingface.co/cocorang/FireRed-Image-Edit-1.1-FP8_And_BF16 * FLUX.2 Klein 9B: https://huggingface.co/black-forest-labs/FLUX.2-klein-9B * Qwen2.5-VL 7B (Qwen2.5-VL-7B-Instruct-abliterated): https://huggingface.co/huihui-ai/Qwen2.5-VL-7B-Instruct-abliterated (Needed for Qwen-Image and FireRed-Image-Edit) * Qwen3 4B (Huihui-Qwen3-4B-abliterated-v2): https://huggingface.co/chinmankokumin/Qwen3-4B-abliterated-v2 (Needed for Z-Image and FLUX.2 Klein 4B) * Qwen3 4B Instruct-2507: (Huihui-Qwen3-4B-Instruct-2507-abliterated): https://huggingface.co/huihui-ai/Huihui-Qwen3-4B-Instruct-2507-abliterated (Alternate text encoder for Z-Image or FLUX.2 Klein 4B) * Qwen3 8B (Huihui-Qwen3-8B-abliterated-v2): https://huggingface.co/huihui-ai/Huihui-Qwen3-8B-abliterated-v2 (Needed for FLUX.2 Klein 9B) * Qwen3-VL 4B (Huihui-Qwen3-VL-4B-Instruct-abliterated): https://huggingface.co/ahmed22xa/Huihui-Qwen3-VL-4B-Instruct-abliterated-comfy (Needed for Krea2) * Qwen3-VL 8B (Huihui-Qwen3-VL-8B-Instruct-abliterated): https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated (Needed for Boogu-Image and Ideogram4) For Krea2 models and Qwen-Image-Edit 2511, Since they are already quantized INT4 ConvRot W4A4 by LAXMAYDAY, I fixed keys of those models to convrot_w4a4 for working on official ComfyUI. That python script I created used ChatGPT 5.6 Sol is convert_int4_tensorwise_to_convrot_w4a4.py. The rest of them are used Starnodes Model Converter, made by Starnodes2024, quantized from BF16 models https://github.com/Starnodes2024/comfyui-starnodes-modelconverter Or qu...

--- tags: - comfyui - int4 - convrot - w4a4 - krea2 - qwenimage - fireredimageedit - qwen2_5_vl - qwen3 - qwen3_vl --- These models are quantized INT4 Convrot W4A4 for latest ComfyUI. It has somewhat inferior image quality than BF16/GGUF Q8/INT8 Convrot but fast in Ampere(RTX30x0)/Ada Lovelace(RTX40x0) Original models that I used: * Krea2 Turbo: https://huggingface.co/LAXMAYDAY/Krea-2-Turbo-int4-tensorwise-mixed * Krea2 Raw: https://huggingface.co/LAXMAYDAY/Krea-2-Raw-int4-tensorwise-mixed * Qwen-Image-2512: https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI * Qwen-Image-Edit-2511: https://huggingface.co/LAXMAYDAY/Qwen-Image-Edit-2511-int4-tensorwise-mixed * FireRed-Image-Edit 1.1: https://huggingface.co/cocorang/FireRed-Image-Edit-1.1-FP8_And_BF16 * FLUX.2 Klein 9B: https://huggingface.co/black-forest-labs/FLUX.2-klein-9B * Qwen2.5-VL 7B: (Qwen2.5-VL-7B-Instruct-abliterated): https://huggingface.co/huihui-ai/Qwen2.5-VL-7B-Instruct-abliterated (Needed for Qwen-Image and FireRed-Image-Edit) * Qwen3 4B (Huihui-Qwen3-4B-abliterated-v2): https://huggingface.co/chinmankokumin/Qwen3-4B-abliterated-v2 (Needed for Z-Image and FLUX.2 Klein 4B) * Qwen3 8B (Huihui-Qwen3-8B-abliterated-v2): https://huggingface.co/huihui-ai/Huihui-Qwen3-8B-abliterated-v2 (Needed for FLUX.2 Klein 9B) * Qwen3-VL 4B (Huihui-Qwen3-VL-4B-Instruct-abliterated): https://huggingface.co/ahmed22xa/Huihui-Qwen3-VL-4B-Instruct-abliterated-comfy (Needed for Krea2) * Qwen3-VL 8B (Huihui-Qwen3-VL-8B-Instruct-abliterated): https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated (Needed for Boogu-Image and Ideogram4) For Krea2 models and Qwen-Image-Edit 2511, Since they are already quantized INT4 ConvRot W4A4 by LAXMAYDAY, I fixed keys of those models to convrot_w4a4 for working on official ComfyUI. That python script I created used ChatGPT 5.6 Sol is convert_int4_tensorwise_to_convrot_w4a4.py. The rest of them are used Starnodes Model Converter, made by Starnodes2024, quantized from BF16 models https://github.com/Starnodes2024/comfyui-starnodes-modelconverter convert_int4_tensorwise_to_convrot_w4a4.py Script usage (not so useful because I already converted and uploaded) Not actual convert, but test run * python convert_int4_tensorwise_to_convrot_w4a4.py model.safetensors --dry-run Save to new model(convrot_w4a4 model for ComfyUI) * python convert_int4_tensorwi...