VibeVoice-ComfyUI

VibeVoice ComfyUI Nodes

A comprehensive ComfyUI integration for Microsoft's VibeVoice text-to-speech model, enabling high-quality single and multi-speaker voice synthesis directly within your ComfyUI workflows.

✨ Features

Core Functionality

• 🎤 Single Speaker TTS: Generate natural speech with optional voice cloning
• 👥 Multi-Speaker Conversations: Support for up to 4 distinct speakers
• 🎯 Voice Cloning: Clone voices from audio samples
• 🎨 LoRA Support: Fine-tune voices with custom LoRA adapters (v1.4.0+)
• 🎚️ Voice Speed Control: Adjust speech rate by modifying reference voice speed (v1.5.0+)
• 📝 Text File Loading: Load scripts from text files
• 📚 Automatic Text Chunking: Handles long texts seamlessly with configurable chunk size
• ⏸️ Custom Pause Tags: Insert silences with [pause] and [pause:ms] tags (wrapper feature)
• 🔄 Node Chaining: Connect multiple VibeVoice nodes for complex workflows
• ⏹️ Interruption Support: Cancel operations before or between generations
• 🔧 Flexible Configuration: Control temperature, sampling, and guidance scale

Performance & Optimization

• ⚡ Attention Mechanisms: Choose between auto, eager, sdpa, flash_attention_2 or sage
• 🎛️ Diffusion Steps: Adjustable quality vs speed trade-off (default: 20)
• 💾 Memory Management: Toggle automatic VRAM cleanup after generation
• 🧹 Free Memory Node: Manual memory control for complex workflows
• 🍎 Apple Silicon Support: Native GPU acceleration on M1/M2/M3 Macs via MPS
• 🔢 8-Bit Quantization: Perfect audio quality with high VRAM reduction
• 🔢 4-Bit Quantization: Maximum VRAM savings with minimal quality loss

Compatibility & Installation

• 📦 Self-Contained: Embedded VibeVoice code, no external dependencies
• 🔄 Universal Compatibility: Adaptive support for transformers v4.51.3+
• 🖥️ Cross-Platform: Works on Windows, Linux, and macOS
• 🎮 Multi-Backend: Supports CUDA, CPU, and MPS (Apple Silicon)

🎥 Video Demo

📦 Installation

Automatic Installation (Recommended)

1. Clone this repository into your ComfyUI custom nodes folder:

cd ComfyUI/custom_nodes
git clone https://github.com/Enemyx-net/VibeVoice-ComfyUI

2. Restart ComfyUI - the nodes will automatically install requirements on first use

📥 Model Installation

Manual Download Required

Starting from version 1.6.0, models and tokenizer must be manually downloaded and placed in the correct folder. The wrapper no longer downloads them automatically.

Download Links

Models

You can download VibeVoice models from HuggingFace:

Model	Size	Download Link
VibeVoice-1.5B	~5.4GB	microsoft/VibeVoice-1.5B
VibeVoice-Large	~18.7GB	aoi-ot/VibeVoice-Large
VibeVoice-Large-Q8	~11.6GB	FabioSarracino/VibeVoice-Large-Q8
VibeVoice-Large-Q4	~6.6GB	DevParker/VibeVoice7b-low-vram

Tokenizer (Required)

VibeVoice uses the Qwen2.5-1.5B tokenizer:

• Download from: Qwen2.5-1.5B Tokenizer
• Required files: tokenizer_config.json, vocab.json, merges.txt, tokenizer.json

Installation Steps

1. Create the models folder if it doesn't exist:

   ComfyUI/models/vibevoice/
   

2. Download and organize files in the vibevoice folder:

   ComfyUI/models/vibevoice/
   ├── tokenizer/                 # Place Qwen tokenizer files her