Pocket Tts Onnx
ONNX export of Pocket TTS for lightweight multilingual text-to-speech with zero-shot voice cloning.
Modellquelle
- Art
- Other
- Dateigröße
- 9,50–72,8 MB
- Basismodell
- kyutai/pocket-tts
- Version
- vRevision 651140c
- Aktualisiert
- 21. Sept. 2026
- Downloads
- 0
- Aufgaben
- Audio
- Quelle
- Hugging Face
Quellenauszug
ONNX export of Pocket TTS for lightweight multilingual text-to-speech with zero-shot voice cloning.
Quellen
1 Quelle
Quellen
1 QuelleVerifiziert 21. Sept.
Modellartefakte
35 Artefakte
Modellartefakte
35 Artefakteenglish/flow_lm_flow_int8.onnx
onnx · 9,50 MB · SHA-256 1678b23f9d61…7f9d · Hugging Face
Herunterladenenglish/flow_lm_main_int8.onnx
onnx · 72,7 MB · SHA-256 a80a68917b51…0731 · Hugging Face
Herunterladenenglish/mimi_decoder_int8.onnx
onnx · 21,6 MB · SHA-256 ad345d62d428…7f6e · Hugging Face
Herunterladenitalian/flow_lm_flow_int8.onnx
onnx · 9,50 MB · SHA-256 caedd36d311e…8aa4 · Hugging Face
Herunterladenitalian/flow_lm_main_int8.onnx
onnx · 72,7 MB · SHA-256 a84e843ba6ee…fa26 · Hugging Face
Herunterladenitalian/mimi_decoder_int8.onnx
onnx · 21,6 MB · SHA-256 c2c2c3f7052b…4fbd · Hugging Face
Herunterladenportuguese/flow_lm_flow_int8.onnx
onnx · 9,50 MB · SHA-256 9f575eaaabec…bdf3 · Hugging Face
Herunterladenportuguese/flow_lm_main_int8.onnx
onnx · 72,7 MB · SHA-256 d1688f6e618e…aabf · Hugging Face
Herunterladenportuguese/mimi_decoder_int8.onnx
onnx · 21,6 MB · SHA-256 851c2795e3bc…8330 · Hugging Face
Herunterladenportuguese/text_conditioner.onnx
onnx · 15,6 MB · SHA-256 c8295984c9c4…1037 · Hugging Face
Herunterladenspanish/flow_lm_flow_int8.onnx
onnx · 9,50 MB · SHA-256 68bdb08f9adf…411a · Hugging Face
Herunterladenspanish/flow_lm_main_int8.onnx
onnx · 72,7 MB · SHA-256 8932c5a7df30…f86b · Hugging Face
Herunterladenspanish/mimi_decoder_int8.onnx
onnx · 21,6 MB · SHA-256 02adc7fee40a…8b7e · Hugging Face
HerunterladenQuellenauszüge
2 Auszüge
Quellenauszüge
2 Auszüge--- license: cc-by-4.0 language: - en - de - fr - it - pt - es library_name: pocket-tts-onnx base_model: - kyutai/pocket-tts pipeline_tag: text-to-speech tags: - tts - voice-cloning - onnx - onnxruntime --- # Pocket TTS ONNX ONNX export of [Pocket TTS](https://huggingface.co/kyutai/pocket-tts) for lightweight multilingual text-to-speech with zero-shot voice cloning. ## Model Description Pocket TTS is a compact text-to-speech model from Kyutai that supports voice cloning from short audio samples. This ONNX export provides: - **Zero-shot voice cloning** from any audio reference - **Multilingual bundles** for `english_2026-04`, `french_24l`, `german`, `german_24l`, `italian`, `italian_24l`, `portuguese`, `portuguese_24l`, `spanish`, and `spanish_24l` - **INT8 quantized models** for fast CPU inference - **Streaming support** with adaptive chunking for real-time playback - **Temperature control** for generation diversity - **Dual model architecture** for flexible flow matching ## Architecture This export uses a **dual model split** for the Flow LM: ``` flow_lm_main - Transformer/conditioner (produces conditioning vectors) flow_lm_flow - Flow network only (Euler integration for latent sampling) ``` This architecture enables: - **Temperature control**: Adjust generation diversity via noise scaling - **Variable LSD steps**: Trade off speed vs quality - **External flow loop**: Full control over the sampling process ## Performance Performance depends on the selected language bundle, precision, CPU, and `lsd_steps`. - 6-layer bundles such as `english_2026-04`, `german`, `italian`, `portuguese`, and `spanish` are much smaller and faster than the `*_24l` bundles. - INT8 bundles substantially reduce `flow_lm_main`, `flow_lm_flow`, and `mimi_decoder` size for CPU inference. - `mimi_encoder.onnx` and `text_conditioner.onnx` remain FP32. ### Optimized Inference Thread count is automatically tuned to avoid over-subscription on the small sequential matmuls in the autoregressive loop (`intra_op_num_threads=min(cpu_count, 4)`, `inter_op_num_threads=1`). This alone provides a **~2x speedup** over default ORT settings on multi-core machines. ### Decoding Strategy - **Offline (`generate`)**: Uses **threaded parallel decoding** — the mimi decoder runs in a background thread, decoding 12-frame chunks while the flow loop generates the next frames. This overlaps gene...
Source context: 0 downloads · 0 likes · Pipeline text-to-speech · Library pocket-tts-onnx · Repo deepLEARNING786/pocket-tts-onnx
