Qwen2VL Flux ControlNet

Qwen2VL-Flux was released a while ago. It comes with a standalone ControlNet model that works with Flux Dev. Fully compatible with ComfyUI. I works well with Depth and Canny and kinda works with Tile and Realistic Lineart. You can also combine Depth and Canny. Usually works well with strength 0.6-0.8 depending on the image. You might need to run Flux at FP8 to avoid OOM. There's a sample workflow in this repo that you can try on ComfyUI. The original project can be found here: https://huggingface.co/Djrango/Qwen2vl-Flux The model in my repo is simply the weights from https://huggingface.co/Djrango/Qwen2vl-Flux/tree/main/controlnet All credit belongs to the original creator of the model Pengqi Lu. --- license: other license_name: flux-1-dev-non-commercial-license license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md ---

Source context: 0 downloads · 21 likes · Repo Nap/Qwen2VL-Flux-ControlNet