ONNX export of Pocket TTS for lightweight multilingual text-to-speech with zero-shot voice cloning.
Modellquelle
Quellenauszug
ONNX export of Pocket TTS for lightweight multilingual text-to-speech with zero-shot voice cloning.
Quellen
1 QuelleVerifiziert 22. Sept.
Modellartefakte
64 Artefakteonnx/english_2026-04/flow_lm_flow_int8.onnx
onnx · 9,50 MB · SHA-256 3dd781ee5abe…635d · Hugging Face
Herunterladenonnx/english_2026-04/flow_lm_flow.onnx
onnx · 37,3 MB · SHA-256 085d239f6889…8062 · Hugging Face
HerunterladenQuellenauszüge
2 Auszügeonnx/english_2026-04/flow_lm_main_int8.onnx
onnx · 72,8 MB · SHA-256 f9bd8106b79a…0116 · Hugging Face
onnx/english_2026-04/flow_lm_main.onnx
onnx · 289 MB · SHA-256 6d18315e2c33…190f · Hugging Face
Herunterladenonnx/english_2026-04/mimi_decoder_int8.onnx
onnx · 21,6 MB · SHA-256 3630450a3297…f925 · Hugging Face
Herunterladenonnx/english_2026-04/mimi_decoder.onnx
onnx · 39,6 MB · SHA-256 86f038caa02a…e802 · Hugging Face
Herunterladenonnx/english_2026-04/mimi_encoder_int8.onnx
onnx · 19,8 MB · SHA-256 abb46f1ad0b8…c855 · Hugging Face
Herunterladenonnx/english_2026-04/mimi_encoder.onnx
onnx · 37,9 MB · SHA-256 853e2ca623b8…6e3d · Hugging Face
Herunterladenonnx/english_2026-04/text_conditioner_int8.onnx
onnx · 15,6 MB · SHA-256 24c0642bff11…5ac3 · Hugging Face
Herunterladenonnx/english_2026-04/text_conditioner.onnx
onnx · 15,6 MB · SHA-256 4ecee995fb69…47bb · Hugging Face
Herunterladenonnx/english_2026-04/voices.bin
bin · 50,0 MB · SHA-256 044364b05514…d625 · Hugging Face
Herunterladenonnx/french_24l/flow_lm_flow_int8.onnx
onnx · 9,50 MB · SHA-256 d340c549d5a1…8701 · Hugging Face
Herunterladenonnx/french_24l/flow_lm_flow.onnx
onnx · 37,3 MB · SHA-256 0a098e70f484…4d4a · Hugging Face
Herunterladenonnx/french_24l/flow_lm_main_int8.onnx
onnx · 291 MB · SHA-256 6130a6b98fae…a129 · Hugging Face
Herunterladenonnx/french_24l/flow_lm_main.onnx
onnx · 1,13 GB · SHA-256 4cf6b6571065…5609 · Hugging Face
Herunterladenonnx/french_24l/mimi_decoder_int8.onnx
onnx · 21,6 MB · SHA-256 b329ff3de3aa…8d8c · Hugging Face
Herunterladenonnx/french_24l/mimi_decoder.onnx
onnx · 39,6 MB · SHA-256 7c46912a3e2b…714a · Hugging Face
Herunterladenonnx/french_24l/mimi_encoder_int8.onnx
onnx · 19,8 MB · SHA-256 f661fcb2dbf3…cd1b · Hugging Face
Herunterladenonnx/french_24l/mimi_encoder.onnx
onnx · 37,9 MB · SHA-256 790a82fb8041…bfd4 · Hugging Face
Herunterladenonnx/french_24l/text_conditioner_int8.onnx
onnx · 15,6 MB · SHA-256 bc74572507e0…859a · Hugging Face
Herunterladenonnx/french_24l/text_conditioner.onnx
onnx · 15,6 MB · SHA-256 89d1b6ac55e6…1e65 · Hugging Face
Herunterladenonnx/german_24l/flow_lm_flow_int8.onnx
onnx · 9,50 MB · SHA-256 2b0eb8381c49…f06c · Hugging Face
Herunterladenonnx/german_24l/flow_lm_flow.onnx
onnx · 37,3 MB · SHA-256 3b6dceddb6ea…43a1 · Hugging Face
Herunterladenonnx/german_24l/flow_lm_main_int8.onnx
onnx · 291 MB · SHA-256 3d9661a01a08…1d68 · Hugging Face
Herunterladenonnx/german_24l/flow_lm_main.onnx
onnx · 1,13 GB · SHA-256 7ee0cf9bdae4…0fd7 · Hugging Face
Herunterladenonnx/german_24l/mimi_decoder_int8.onnx
onnx · 21,6 MB · SHA-256 3fe868810d66…083b · Hugging Face
Herunterladenonnx/german_24l/mimi_decoder.onnx
onnx · 39,6 MB · SHA-256 e068e4b2a30e…77f6 · Hugging Face
Herunterladenonnx/german_24l/mimi_encoder_int8.onnx
onnx · 19,8 MB · SHA-256 9c235c292b5e…95c3 · Hugging Face
Herunterladenonnx/german_24l/mimi_encoder.onnx
onnx · 37,9 MB · SHA-256 7367f8af75d7…b7f7 · Hugging Face
Herunterladenonnx/german_24l/text_conditioner_int8.onnx
onnx · 15,6 MB · SHA-256 e1e93583d26d…8c38 · Hugging Face
Herunterladenonnx/german_24l/text_conditioner.onnx
onnx · 15,6 MB · SHA-256 e9e939c3da9b…85d7 · Hugging Face
Herunterladenonnx/german/flow_lm_flow_int8.onnx
onnx · 9,50 MB · SHA-256 2b0eb8381c49…f06c · Hugging Face
Herunterladenonnx/german/flow_lm_main_int8.onnx
onnx · 72,8 MB · SHA-256 3d5e9cd303ec…81ef · Hugging Face
Herunterladenonnx/german/mimi_decoder_int8.onnx
onnx · 21,6 MB · SHA-256 3fe868810d66…083b · Hugging Face
Herunterladenonnx/german/mimi_encoder_int8.onnx
onnx · 19,8 MB · SHA-256 d11af63a34c0…a598 · Hugging Face
Herunterladenonnx/german/text_conditioner_int8.onnx
onnx · 15,6 MB · SHA-256 de27b06fcd39…71b7 · Hugging Face
Herunterladenonnx/german/text_conditioner.onnx
onnx · 15,6 MB · SHA-256 a004c74047bc…69f1 · Hugging Face
Herunterladenonnx/italian_24l/flow_lm_flow_int8.onnx
onnx · 9,50 MB · SHA-256 21b2bec2f9ae…9129 · Hugging Face
Herunterladenonnx/italian_24l/flow_lm_flow.onnx
onnx · 37,3 MB · SHA-256 3646665d2b64…898f · Hugging Face
Herunterladenonnx/italian_24l/flow_lm_main_int8.onnx
onnx · 291 MB · SHA-256 8c7b0dc076e6…11d4 · Hugging Face
Herunterladenonnx/italian_24l/flow_lm_main.onnx
onnx · 1,13 GB · SHA-256 e213ce648733…3360 · Hugging Face
Herunterladenonnx/italian_24l/mimi_decoder_int8.onnx
onnx · 21,6 MB · SHA-256 f120bc5cddca…aa03 · Hugging Face
Herunterladenonnx/italian_24l/mimi_decoder.onnx
onnx · 39,6 MB · SHA-256 f474670d1494…efbb · Hugging Face
Herunterladenonnx/italian_24l/mimi_encoder_int8.onnx
onnx · 19,8 MB · SHA-256 9f45bdf936a6…ed0d · Hugging Face
Herunterladenonnx/italian_24l/mimi_encoder.onnx
onnx · 37,9 MB · SHA-256 1f436e797ffd…1208 · Hugging Face
Herunterladenonnx/italian_24l/text_conditioner_int8.onnx
onnx · 15,6 MB · SHA-256 e3113c92b9e8…2fe3 · Hugging Face
Herunterladenonnx/italian_24l/text_conditioner.onnx
onnx · 15,6 MB · SHA-256 00ff8327e832…d83d · Hugging Face
Herunterladenonnx/italian/flow_lm_flow_int8.onnx
onnx · 9,50 MB · SHA-256 21b2bec2f9ae…9129 · Hugging Face
Herunterladenonnx/italian/flow_lm_flow.onnx
onnx · 37,3 MB · SHA-256 3646665d2b64…898f · Hugging Face
Herunterladenonnx/italian/flow_lm_main_int8.onnx
onnx · 72,8 MB · SHA-256 f43ce4d82347…5055 · Hugging Face
Herunterladenonnx/italian/mimi_decoder_int8.onnx
onnx · 21,6 MB · SHA-256 f120bc5cddca…aa03 · Hugging Face
Herunterladenonnx/italian/mimi_decoder.onnx
onnx · 39,6 MB · SHA-256 f474670d1494…efbb · Hugging Face
Herunterladen--- license: cc-by-4.0 language: - en - de - fr - it - pt - es library_name: pocket-tts-onnx base_model: - kyutai/pocket-tts pipeline_tag: text-to-speech tags: - tts - voice-cloning - onnx - onnxruntime --- # Pocket TTS ONNX ONNX export of [Pocket TTS](https://huggingface.co/kyutai/pocket-tts) for lightweight multilingual text-to-speech with zero-shot voice cloning. ## Model Description Pocket TTS is a compact text-to-speech model from Kyutai that supports voice cloning from short audio samples. This ONNX export provides: - **Zero-shot voice cloning** from any audio reference - **Multilingual bundles** for `english_2026-04`, `french_24l`, `german`, `german_24l`, `italian`, `italian_24l`, `portuguese`, `portuguese_24l`, `spanish`, and `spanish_24l` - **INT8 quantized models** for fast CPU inference - **Streaming support** with adaptive chunking for real-time playback - **Temperature control** for generation diversity - **Dual model architecture** for flexible flow matching ## Architecture This export uses a **dual model split** for the Flow LM: ``` flow_lm_main - Transformer/conditioner (produces conditioning vectors) flow_lm_flow - Flow network only (Euler integration for latent sampling) ``` This architecture enables: - **Temperature control**: Adjust generation diversity via noise scaling - **Variable LSD steps**: Trade off speed vs quality - **External flow loop**: Full control over the sampling process ## Performance Performance depends on the selected language bundle, precision, CPU, and `lsd_steps`. - 6-layer bundles such as `english_2026-04`, `german`, `italian`, `portuguese`, and `spanish` are much smaller and faster than the `*_24l` bundles. - INT8 bundles substantially reduce `flow_lm_main`, `flow_lm_flow`, and `mimi_decoder` size for CPU inference. - `mimi_encoder.onnx` and `text_conditioner.onnx` remain FP32. ### Optimized Inference Thread count is automatically tuned to avoid over-subscription on the small sequential matmuls in the autoregressive loop (`intra_op_num_threads=min(cpu_count, 4)`, `inter_op_num_threads=1`). This alone provides a **~2x speedup** over default ORT settings on multi-core machines. ### Decoding Strategy - **Offline (`generate`)**: Uses **threaded parallel decoding** — the mimi decoder runs in a background thread, decoding 12-frame chunks while the flow loop generates the next frames. This overlaps gene...
Source context: 0 downloads · 0 likes · Pipeline text-to-speech · Library pocket-tts-onnx · Repo vlapky/pocket-tts-onnx