Have a ComfyUI workflow? Get a readable Workflow Doc in your browser.Make a workflow readable.Try it now ↗
ONNX export of Pocket TTS for lightweight multilingual text-to-speech with zero-shot voice cloning.
Model source
Source excerpt
ONNX export of Pocket TTS for lightweight multilingual text-to-speech with zero-shot voice cloning.
Sources
1 sourceVerified Sep 22
Model artifacts
64 artifactsSource excerpts
2 excerptsonnx/english_2026-04/flow_lm_main_int8.onnx
onnx · 72.8 MB · SHA-256 f9bd8106b79a…0116 · Hugging Face
onnx/english_2026-04/flow_lm_main.onnx
onnx · 289 MB · SHA-256 6d18315e2c33…190f · Hugging Face
Downloadonnx/english_2026-04/mimi_decoder_int8.onnx
onnx · 21.6 MB · SHA-256 3630450a3297…f925 · Hugging Face
Downloadonnx/english_2026-04/mimi_decoder.onnx
onnx · 39.6 MB · SHA-256 86f038caa02a…e802 · Hugging Face
Downloadonnx/english_2026-04/mimi_encoder_int8.onnx
onnx · 19.8 MB · SHA-256 abb46f1ad0b8…c855 · Hugging Face
Downloadonnx/english_2026-04/mimi_encoder.onnx
onnx · 37.9 MB · SHA-256 853e2ca623b8…6e3d · Hugging Face
Downloadonnx/english_2026-04/text_conditioner_int8.onnx
onnx · 15.6 MB · SHA-256 24c0642bff11…5ac3 · Hugging Face
Downloadonnx/english_2026-04/text_conditioner.onnx
onnx · 15.6 MB · SHA-256 4ecee995fb69…47bb · Hugging Face
Downloadonnx/french_24l/flow_lm_flow_int8.onnx
onnx · 9.50 MB · SHA-256 d340c549d5a1…8701 · Hugging Face
Downloadonnx/french_24l/flow_lm_main_int8.onnx
onnx · 291 MB · SHA-256 6130a6b98fae…a129 · Hugging Face
Downloadonnx/french_24l/mimi_decoder_int8.onnx
onnx · 21.6 MB · SHA-256 b329ff3de3aa…8d8c · Hugging Face
Downloadonnx/french_24l/mimi_encoder_int8.onnx
onnx · 19.8 MB · SHA-256 f661fcb2dbf3…cd1b · Hugging Face
Downloadonnx/french_24l/text_conditioner_int8.onnx
onnx · 15.6 MB · SHA-256 bc74572507e0…859a · Hugging Face
Downloadonnx/french_24l/text_conditioner.onnx
onnx · 15.6 MB · SHA-256 89d1b6ac55e6…1e65 · Hugging Face
Downloadonnx/german_24l/flow_lm_flow_int8.onnx
onnx · 9.50 MB · SHA-256 2b0eb8381c49…f06c · Hugging Face
Downloadonnx/german_24l/flow_lm_main_int8.onnx
onnx · 291 MB · SHA-256 3d9661a01a08…1d68 · Hugging Face
Downloadonnx/german_24l/mimi_decoder_int8.onnx
onnx · 21.6 MB · SHA-256 3fe868810d66…083b · Hugging Face
Downloadonnx/german_24l/mimi_encoder_int8.onnx
onnx · 19.8 MB · SHA-256 9c235c292b5e…95c3 · Hugging Face
Downloadonnx/german_24l/text_conditioner_int8.onnx
onnx · 15.6 MB · SHA-256 e1e93583d26d…8c38 · Hugging Face
Downloadonnx/german_24l/text_conditioner.onnx
onnx · 15.6 MB · SHA-256 e9e939c3da9b…85d7 · Hugging Face
Downloadonnx/german/text_conditioner_int8.onnx
onnx · 15.6 MB · SHA-256 de27b06fcd39…71b7 · Hugging Face
Downloadonnx/italian_24l/flow_lm_flow_int8.onnx
onnx · 9.50 MB · SHA-256 21b2bec2f9ae…9129 · Hugging Face
Downloadonnx/italian_24l/flow_lm_main_int8.onnx
onnx · 291 MB · SHA-256 8c7b0dc076e6…11d4 · Hugging Face
Downloadonnx/italian_24l/mimi_decoder_int8.onnx
onnx · 21.6 MB · SHA-256 f120bc5cddca…aa03 · Hugging Face
Downloadonnx/italian_24l/mimi_encoder_int8.onnx
onnx · 19.8 MB · SHA-256 9f45bdf936a6…ed0d · Hugging Face
Downloadonnx/italian_24l/text_conditioner_int8.onnx
onnx · 15.6 MB · SHA-256 e3113c92b9e8…2fe3 · Hugging Face
Downloadonnx/italian_24l/text_conditioner.onnx
onnx · 15.6 MB · SHA-256 00ff8327e832…d83d · Hugging Face
Downloadonnx/italian/flow_lm_flow_int8.onnx
onnx · 9.50 MB · SHA-256 21b2bec2f9ae…9129 · Hugging Face
Downloadonnx/italian/flow_lm_main_int8.onnx
onnx · 72.8 MB · SHA-256 f43ce4d82347…5055 · Hugging Face
Downloadonnx/italian/mimi_decoder_int8.onnx
onnx · 21.6 MB · SHA-256 f120bc5cddca…aa03 · Hugging Face
Download--- license: cc-by-4.0 language: - en - de - fr - it - pt - es library_name: pocket-tts-onnx base_model: - kyutai/pocket-tts pipeline_tag: text-to-speech tags: - tts - voice-cloning - onnx - onnxruntime --- # Pocket TTS ONNX ONNX export of [Pocket TTS](https://huggingface.co/kyutai/pocket-tts) for lightweight multilingual text-to-speech with zero-shot voice cloning. ## Model Description Pocket TTS is a compact text-to-speech model from Kyutai that supports voice cloning from short audio samples. This ONNX export provides: - **Zero-shot voice cloning** from any audio reference - **Multilingual bundles** for `english_2026-04`, `french_24l`, `german`, `german_24l`, `italian`, `italian_24l`, `portuguese`, `portuguese_24l`, `spanish`, and `spanish_24l` - **INT8 quantized models** for fast CPU inference - **Streaming support** with adaptive chunking for real-time playback - **Temperature control** for generation diversity - **Dual model architecture** for flexible flow matching ## Architecture This export uses a **dual model split** for the Flow LM: ``` flow_lm_main - Transformer/conditioner (produces conditioning vectors) flow_lm_flow - Flow network only (Euler integration for latent sampling) ``` This architecture enables: - **Temperature control**: Adjust generation diversity via noise scaling - **Variable LSD steps**: Trade off speed vs quality - **External flow loop**: Full control over the sampling process ## Performance Performance depends on the selected language bundle, precision, CPU, and `lsd_steps`. - 6-layer bundles such as `english_2026-04`, `german`, `italian`, `portuguese`, and `spanish` are much smaller and faster than the `*_24l` bundles. - INT8 bundles substantially reduce `flow_lm_main`, `flow_lm_flow`, and `mimi_decoder` size for CPU inference. - `mimi_encoder.onnx` and `text_conditioner.onnx` remain FP32. ### Optimized Inference Thread count is automatically tuned to avoid over-subscription on the small sequential matmuls in the autoregressive loop (`intra_op_num_threads=min(cpu_count, 4)`, `inter_op_num_threads=1`). This alone provides a **~2x speedup** over default ORT settings on multi-core machines. ### Decoding Strategy - **Offline (`generate`)**: Uses **threaded parallel decoding** — the mimi decoder runs in a background thread, decoding 12-frame chunks while the flow loop generates the next frames. This overlaps gene...
Source context: 0 downloads · 0 likes · Pipeline text-to-speech · Library pocket-tts-onnx · Repo vlapky/pocket-tts-onnx
