Skip to content
Node packVerifiedExternal
Open source

ComfyUI_FL-CosyVoice3

Maintainer@filliptmCgrade

Package profile

Status
Verified
Publisher
@filliptm
Source
GitHub
Stars
149

README

FL CosyVoice3

Advanced text-to-speech nodes for ComfyUI powered by the CosyVoice3 model family. Features zero-shot voice cloning, cross-lingual synthesis, and voice conversion.

CosyVoice Patreon

Workflow Preview

Features

  • Zero-Shot Voice Cloning - Clone any voice from 3-30 seconds of reference audio
  • Cross-Lingual Synthesis - Speak different languages while preserving voice characteristics
  • Voice Conversion - Transform one voice to sound like another
  • 9 Languages - Chinese, English, Japanese, Korean, German, Spanish, French, Italian, Russian
  • Auto Transcription - Built-in Whisper integration for reference audio
  • Speed Control - Adjustable speech rate (0.5x - 2.0x)

Nodes

NodeDescription
Model LoaderDownloads and caches CosyVoice models
Zero-Shot CloneClone voices from reference audio
Cross-LingualGenerate speech in different languages
Voice ConversionConvert source audio to target voice
DialogMulti-speaker dialog synthesis with up to 4 voices
Audio CropTrim audio to specific time ranges

New Nodes

NodeDescription
Instruct2Clone a voice with instruct text
Save SpeakerSave voice preset
Speaker CloneVoice clone with voice preset
Speaker Instruct2Voice clone with voice preset and instruct text

Installation

ComfyUI Manager

Search for "FL CosyVoice3" and install.

Manual

cd ComfyUI/custom_nodes
git clone https://github.com/filliptm/ComfyUI_FL-CosyVoice3.git
cd ComfyUI_FL-CosyVoice3
pip install -r requirements.txt

Quick Start

  1. Add FL CosyVoice3 Model Loader and select Fun-CosyVoice3-0.5B
  2. Connect to Zero-Shot Clone or Cross-Lingual node
  3. Provide reference audio (3-30 seconds recommended)
  4. Enter your text and generate

Models

ModelSizeNotes
Fun-CosyVoice3-0.5B~2GBRecommended
CosyVoice2-0.5B~2GBAlternative
CosyVoice-300M~1.2GBLightweight

Models download automatically on first use to ComfyUI/models/cosyvoice/.

Notice: CosyVoice-300M won't work well, do not use.

Nodes

Instruct2

Named Instruct2 because in CosyVoice's source code, there is an instruct1 function only for CosyVoice1 model. Instruct2 is for CosyVoice2 and CosyVoice3 model.

Save Speaker

Choose a refernce voice with 3~10 seconds is the best, no more than 30 seconds.

If reference text is empty, it will try to script reference audio into text as reference text.

Speaker preset is saved to Comfyui's model folder/cosyvoice/speaker.

Be notieced: a voice preset saved with CosyVoice3/2 model, can not be used with CosyVoice2/3 model.

Speaker Clone

Be notieced: a voice preset saved with CosyVoice3/2 model, can not be used with CosyVoice2/3 model.

Be notieced2: CosyVoice's official speaker preset spk2info.pt from CosyVoice-300M-SFT model is not supported.

If you really want to use those speaker presets from spk2info.pt, you can find those 8 voices at: https://fun-audio-llm.github.io/#CosyVoice-basic

Then you can just download those audios and save them into speaker presets with Save Speaker node.

Using a speaker preset is excatly the same as using that speaker's reference audio for voice clone, same process, same result.

Speaker Instruct2

Load all speaker presets saved with Save Speaker node into a list, then you can pick one for tts with instruct text.

Notice: instruct text can not be empty.

Requirements

  • Python 3.10+
  • 8GB

Nodes in this pack

10 nodes
  • FL_CosyVoice3_AudioCrop
  • FL_CosyVoice3_CrossLingual
  • FL_CosyVoice3_Dialog
  • FL_CosyVoice3_Instruct2
  • FL_CosyVoice3_ModelLoader
  • FL_CosyVoice3_SaveSpeaker
  • FL_CosyVoice3_SpeakerClone
  • FL_CosyVoice3_SpeakerInstruct2
  • FL_CosyVoice3_VoiceConversion
  • FL_CosyVoice3_ZeroShot

Related resources

1 connection

Sources

3 sources
GitHubSourceVersion bfd1a2b50557668c5a1ad34487fc6db21d2e28d7
github.com/filliptm/ComfyUI_FL-CosyVoice3

Verified Oct 14

Source excerpts

1 excerpt

Source context: Repo filliptm/ComfyUI_FL-CosyVoice3