Pocket Tts GGUF

--- license: cc-by-4.0 language: - en - de - es - it - pt - fr base_model: - kyutai/pocket-tts pipeline_tag: text-to-speech tags: - tts - text-to-speech - voice-cloning - pocket-tts - mimi - kyutai - gguf - crispasr library_name: ggml --- # Pocket TTS — GGUF (ggml-quantised) GGUF / ggml conversion of [`kyutai/pocket-tts`](https://huggingface.co/kyutai/pocket-tts) for use with **[CrispStrobe/CrispASR](https://github.com/CrispStrobe/CrispASR)**. Pocket TTS is a lightweight (~100M param) continuous-latent autoregressive TTS model from Kyutai, based on the CALM paper (arXiv:2509.06926). Unlike codebook-based TTS models, Pocket TTS emits continuous float vectors — no discrete tokens, no softmax sampling: - **FlowLM backbone** — causal transformer (1024D, 16 heads, 6 layers; 24 layers for the French preview, RoPE, GELU) operating at 12.5 Hz - **Consistency head** — SimpleMLPAdaLN (512D, 6 ResBlocks) with timestep embedding → one-step LSD decode → 32-dim continuous latent vectors - **Mimi VAE decoder** — SEANet upsample convolutions + 2-layer transformer → 24 kHz PCM - **Mimi VAE encoder** *(voice-cloning builds only)* — SEANet downsample + 2-layer transformer + speaker projection → reference conditioning - **Text tokenizer** — SentencePiece BPE (4000 vocab, embedded in GGUF) Single GGUF file — no separate codec companion needed (Mimi weights and the tokenizer are embedded). Released under **CC-BY-4.0** license. ## Voice cloning Pocket TTS is zero-shot: it clones the timbre of a short reference clip. The **voice-cloning builds** (the files *without* `novc` in the name) embed the Mimi VAE **encoder** and speaker projection needed to condition on a reference; the English-only `novc` builds omit that encoder and are ~20 MB smaller. ```bash # clone the timbre of ref.wav (any sample rate; mono is used) ./build/bin/crispasr --backend pocket-tts -m pocket-tts-english-f16.gguf \ --voice ref.wav \ --tts "The quick brown fox jumps over the lazy dog." \ --tts-output fox.wav --seed 42 ``` Pocket TTS produces near-silence without voice conditioning, so if you omit `--voice` a built-in default reference is used automatically. Use a clean, single-speaker reference of a few seconds for best results. ## Files The multilingual Q8_0/F16 files are full voice-cloning models. German, Spanish, Italian, and Portuguese are Kyutai's distilled 6-layer releases; French is the...

--- license: cc-by-4.0 language: - en base_model: - kyutai/pocket-tts pipeline_tag: text-to-speech tags: - tts - text-to-speech - voice-cloning - pocket-tts - mimi - kyutai - gguf - crispasr library_name: ggml --- # Pocket TTS — GGUF (ggml-quantised) GGUF / ggml conversion of [`kyutai/pocket-tts`](https://huggingface.co/kyutai/pocket-tts) for use with **[CrispStrobe/CrispASR](https://github.com/CrispStrobe/CrispASR)**. Pocket TTS is a lightweight (~100M param) continuous-latent autoregressive TTS model from Kyutai, based on the CALM paper (arXiv:2509.06926). Unlike codebook-based TTS models, Pocket TTS emits continuous float vectors — no discrete tokens, no softmax sampling: - **FlowLM backbone** — causal transformer (1024D, 16 heads, 6 layers, RoPE, GELU) operating at 12.5 Hz - **Consistency head** — SimpleMLPAdaLN (512D, 6 ResBlocks) with timestep embedding → one-step LSD decode → 32-dim continuous latent vectors - **Mimi VAE decoder** — SEANet upsample convolutions + 2-layer transformer → 24 kHz PCM - **Mimi VAE encoder** *(voice-cloning builds only)* — SEANet downsample + 2-layer transformer + speaker projection → reference conditioning - **Text tokenizer** — SentencePiece BPE (4000 vocab, embedded in GGUF) Single GGUF file — no separate codec companion needed (Mimi weights and the tokenizer are embedded). Released under **CC-BY-4.0** license. ## Voice cloning Pocket TTS is zero-shot: it clones the timbre of a short reference clip. The **voice-cloning builds** (`pocket-tts-english-{f16,q8_0,q4_k}.gguf` — the ones *without* `novc` in the name) embed the Mimi VAE **encoder** and speaker projection needed to condition on a reference; the `novc` builds omit that encoder and are ~20 MB smaller. ```bash # clone the timbre of ref.wav (any sample rate; mono is used) ./build/bin/crispasr --backend pocket-tts -m pocket-tts-english-f16.gguf \ --voice ref.wav \ --tts "The quick brown fox jumps over the lazy dog." \ --tts-output fox.wav --seed 42 ``` Pocket TTS produces near-silence without voice conditioning, so if you omit `--voice` a built-in default reference is used automatically. Use a clean, single-speaker reference of a few seconds for best results. ## Files Two families: **voice-cloning** (default, embeds the Mimi encoder) and **`novc`** (decoder only, smaller — use when you only need the built-in default voice). | File | Voice clone | Quan...

Source context: 4522 downloads · 7 likes · Pipeline text-to-speech · Library ggml · Repo cstr/pocket-tts-GGUF