Parakeet Tdt 0.6b v2 GGUF

--- license: cc-by-4.0 base_model: nvidia/parakeet-tdt-0.6b-v2 base_model_relation: quantized library_name: transcribe.cpp pipeline_tag: automatic-speech-recognition language: - en tags: - gguf - transcribe.cpp - asr - speech-to-text - parakeet - conformer - rnnt - tdt transcribe_cpp: wer_librispeech_test_clean: f32: 1.68 f16: 1.68 q8_0: 1.69 q6_k: 1.7 q5_k_m: 1.7 q4_k_m: 1.72 rtf_ryzen_4750u: cpu: 8 vulkan: 15 rtf_m4_max: cpu: 29 metal: 175 streaming: false translate: false lang_detect: false timestamps: token --- # parakeet-tdt-0.6b-v2: transcribe.cpp GGUF GGUF conversions of [nvidia/parakeet-tdt-0.6b-v2](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2) for use with [transcribe.cpp](https://github.com/handy-computer/transcribe.cpp). Ported from upstream commit [1b149a3](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2/commit/1b149a3), pinned 2026-04-15. Validated against the NeMo reference at transcribe.cpp commit [bf0d0b7](https://github.com/handy-computer/transcribe.cpp/tree/bf0d0b7) on 2026-04-18. Offline English speech-to-text. A 0.6B-parameter Conformer encoder with a TDT/RNNT transducer decoder. Takes a 16 kHz mono WAV and produces a transcript with optional token-level timestamps. Not a streaming model; no multilingual capability (see v3 for that). ## Downloads | Quantization | Download | Size | WER (LibriSpeech test-clean) | | --- | --- | ---: | ---: | | F32 | [parakeet-tdt-0.6b-v2-F32.gguf](https://huggingface.co/handy-computer/parakeet-tdt-0.6b-v2-gguf/resolve/main/parakeet-tdt-0.6b-v2-F32.gguf) | 2.47 GB | 1.68% | | F16 | [parakeet-tdt-0.6b-v2-F16.gguf](https://huggingface.co/handy-computer/parakeet-tdt-0.6b-v2-gguf/resolve/main/parakeet-tdt-0.6b-v2-F16.gguf) | 1.24 GB | 1.68% | | Q8_0 | [parakeet-tdt-0.6b-v2-Q8_0.gguf](https://huggingface.co/handy-computer/parakeet-tdt-0.6b-v2-gguf/resolve/main/parakeet-tdt-0.6b-v2-Q8_0.gguf) | 730 MB | 1.69% | | Q6_K | [parakeet-tdt-0.6b-v2-Q6_K.gguf](https://huggingface.co/handy-computer/parakeet-tdt-0.6b-v2-gguf/resolve/main/parakeet-tdt-0.6b-v2-Q6_K.gguf) | 608 MB | 1.70% | | Q5_K_M | [parakeet-tdt-0.6b-v2-Q5_K_M.gguf](https://huggingface.co/handy-computer/parakeet-tdt-0.6b-v2-gguf/resolve/main/parakeet-tdt-0.6b-v2-Q5_K_M.gguf) | 547 MB | 1.70% | | Q4_K_M | [parakeet-tdt-0.6b-v2-Q4_K_M.gguf](https://huggingface.co/handy-computer/parakeet-tdt-0.6b-v2-gguf/resolve/main/...

Source context: 18 downloads · 0 likes · Pipeline automatic-speech-recognition · Library transcribe.cpp · Repo memoravox/parakeet-tdt-0.6b-v2-gguf