ComfyUI-ThinkingLLM
A multimodal ComfyUI AI node with Qwen3.5, Qwen3-VL, Qwen2.5-VL, Qwen3, and Gemma 4 integrations. Features live thinking in the terminal to see what the LLM is doing in real time. Prompt enhancing, I2T, V2T, A2T....
Perfil del paquete
- Estado
- Verificado
- Publicador
- @goodguy1963
- Fuente
- GitHub
- Estrellas
- 27
Léeme
ComfyUI-ThinkingLLM
ThinkingLLM is a multimodal local-LLM node pack for ComfyUI. It provides clean workflows for Qwen, Gemma 4, GGUF, Whisper ASR, prompt enhancement, image/video understanding, audio analysis, and secure OpenAI-compatible providers.
GPL-3.0 fork of Deaquay/ComfyUI-Qwen3.5-Uncensored, itself derived from huchukato/ComfyUI-QwenVL-Mod and 1038lab/ComfyUI-QwenVL. See LICENSE.
ThinkingLLM Demo Node screenshot
Highlights
- Local Transformers/Hugging Face and GGUF inference
- Image and video understanding with optional mask-focused analysis
- Gemma 4 audio understanding and Whisper speech-to-text
- Prompt enhancers for image and video generation workflows
- Thinking-mode control, live terminal streaming, and a separate
RAW_TRACEoutput - Curated model recommendations and preset-specific generation guidance
- Secure OpenAI-compatible API node for approved remote providers
- Existing compatible models are discovered instead of downloaded twice
Quick install
ComfyUI Manager (recommended)
- Open ComfyUI Manager → Install via Registry.
- Search for
ThinkingLLM. - Click Install and restart ComfyUI.
Manual install
cd ComfyUI/custom_nodes
git clone https://github.com/goodguy1963/ComfyUI-ThinkingLLM.git
cd ComfyUI-ThinkingLLM
pip install -r requirements.txt
For GGUF vision or Gemma 4 audio, also follow the llama.cpp backend installation guide.
Nodes at a glance
| Node | Backend | Purpose |
|---|---|---|
ThinkingLLM | Transformers / HF | Image and video understanding |
ThinkingLLM (Advanced) | Transformers / HF | Full controls and MASK_PREVIEW |
ThinkingLLM Prompt Enhancer | Transformers / HF | Text prompt enhancement |
ThinkingLLM (GGUF) | llama.cpp | GGUF image and video understanding |
ThinkingLLM (GGUF Advanced) | llama.cpp | GGUF advanced controls and MASK_PREVIEW |
ThinkingLLM Gemma 4 Audio (GGUF) | llama.cpp | Gemma 4 audio understanding |
ThinkingLLM Whisper ASR | faster-whisper | Speech-to-text transcription |
ThinkingLLM Prompt Enhancer (GGUF) | llama.cpp | GGUF prompt enhancement |
ThinkingLLM System Prompt Preset | Utility | Reusable system prompts as STRING |
ThinkingLLM API (OpenAI Compatible) | Remote API | Approved OpenAI-compatible providers |
The Transformers/HF nodes are the recommended default when you want the simplest installation. Choose GGUF when you specifically need quantized llama.cpp models or Gemma 4 audio.
Start a workflow
- Add the ThinkingLLM node that matches your backend and task.
- Select a model or an already installed local model.
- Connect image, video, audio, mask, or text inputs as needed.
- Connect
RESPONSEorENHANCED_OUTPUTto a text display or downstream prompt input. - Connect
RAW_TRACEwhen you want generation diagnostics.
Useful defaults:
- Start with
enable_thinking=falsefor transcription and short direct answers. - Enable
stream_tokens_to_terminalwhen diagnosing a slow or unhelpful generation. - Resize very large images before inference to reduce context and memory pressure.
- Use the dedicated Gemma 4 Audio or Whisper node instead of assuming every multimodal model supports audio.
For explanations of thinking mode, model guidance, raw traces, audio, masks, and object-removal prompting, see Features and workflows.
Model families
ThinkingLLM includes curated entries for:
- Qwen3.8, Qwen3.5, Qwen3-VL, Qwen2.5-VL, and Qwen3
- Gemma 4 vision, text, and audio-capable GGUF variants
- Whisper
tinythroughlarge-v3anddistil-large-v3 - Local compatible Transformers checkpoints and GGUF/mmproj pairs
See Models and backends for exact familie
Nodos de este paquete
24 nodos
Nodos de este paquete
24 nodos- AILab_QwenVL
- AILab_QwenVL_Advanced
- AILab_QwenVL_GGUF
- AILab_QwenVL_GGUF_Advanced
- AILab_QwenVL_GGUF_PromptEnhancer
- AILab_QwenVL_PromptEnhancer
- default
- duration_seconds
- multiline
- preset_prompt
- StorySplitNode
- ThinkingLLM_Gemma4_Audio_GGUF
- ThinkingLLM_OpenAICompatibleAPI
- ThinkingLLM_QwenVL
- ThinkingLLM_QwenVL_Advanced
- ThinkingLLM_QwenVL_GGUF
- ThinkingLLM_QwenVL_GGUF_Advanced
- ThinkingLLM_QwenVL_GGUF_PromptEnhancer
- ThinkingLLM_QwenVL_PromptEnhancer
- ThinkingLLM_SystemPromptPreset
- ThinkingLLM_Whisper_ASR
- tooltip
- video_presets
- VRAMCleanup
Fuentes
3 fuentes
Fuentes
3 fuentesVerificado 5 oct
Verificado 5 oct
Extractos de fuentes
1 extracto
Extractos de fuentes
1 extractoSource context: Repo goodguy1963/ComfyUI-ThinkingLLM
