Parakeet Rnnt 0.6b GGUF

--- license: cc-by-4.0 base_model: nvidia/parakeet-rnnt-0.6b base_model_relation: quantized library_name: transcribe.cpp pipeline_tag: automatic-speech-recognition language: - en tags: - gguf - transcribe.cpp - asr - speech-to-text - parakeet - conformer - rnnt transcribe_cpp: wer_librispeech_test_clean: f32: 1.62 f16: 1.62 q8_0: 1.62 q6_k: 1.62 q5_k_m: 1.62 q4_k_m: 1.59 rtf_m4_max: metal: 185.5 cpu: 30 rtf_ryzen_4750u: vulkan: 14.5 cpu: 8 streaming: false translate: false lang_detect: false timestamps: token --- # parakeet-rnnt-0.6b: transcribe.cpp GGUF GGUF conversions of [nvidia/parakeet-rnnt-0.6b](https://huggingface.co/nvidia/parakeet-rnnt-0.6b) for use with [transcribe.cpp](https://github.com/handy-computer/transcribe.cpp). Ported from upstream commit [c0c1f09](https://huggingface.co/nvidia/parakeet-rnnt-0.6b/commit/c0c1f09), pinned 2026-05-10. Validated against the NeMo reference at transcribe.cpp commit [42528dd](https://github.com/handy-computer/transcribe.cpp/tree/42528dd) on 2026-05-10. Offline English speech-to-text with greedy RNN-T decoding. A 0.6B-parameter FastConformer-Large encoder with an RNN-T transducer decoder. Output is lowercase, no punctuation. Not a streaming model and does not translate. ## Downloads | Quantization | Download | Size | WER (LibriSpeech test-clean) | | --- | --- | ---: | ---: | | F32 | [parakeet-rnnt-0.6b-F32.gguf](https://huggingface.co/handy-computer/parakeet-rnnt-0.6b-gguf/resolve/main/parakeet-rnnt-0.6b-F32.gguf) | 2.47 GB | 1.62% | | F16 | [parakeet-rnnt-0.6b-F16.gguf](https://huggingface.co/handy-computer/parakeet-rnnt-0.6b-gguf/resolve/main/parakeet-rnnt-0.6b-F16.gguf) | 1.24 GB | 1.62% | | Q8_0 | [parakeet-rnnt-0.6b-Q8_0.gguf](https://huggingface.co/handy-computer/parakeet-rnnt-0.6b-gguf/resolve/main/parakeet-rnnt-0.6b-Q8_0.gguf) | 730 MB | 1.62% | | Q6_K | [parakeet-rnnt-0.6b-Q6_K.gguf](https://huggingface.co/handy-computer/parakeet-rnnt-0.6b-gguf/resolve/main/parakeet-rnnt-0.6b-Q6_K.gguf) | 601 MB | 1.62% | | Q5_K_M | [parakeet-rnnt-0.6b-Q5_K_M.gguf](https://huggingface.co/handy-computer/parakeet-rnnt-0.6b-gguf/resolve/main/parakeet-rnnt-0.6b-Q5_K_M.gguf) | 540 MB | 1.62% | | Q4_K_M | [parakeet-rnnt-0.6b-Q4_K_M.gguf](https://huggingface.co/handy-computer/parakeet-rnnt-0.6b-gguf/resolve/main/parakeet-rnnt-0.6b-Q4_K_M.gguf) | 476 MB | 1.59% | WER measured on the full LibriSp...

Source context: 5 downloads · 0 likes · Pipeline automatic-speech-recognition · Library transcribe.cpp · Repo memoravox/parakeet-rnnt-0.6b-gguf