Parakeet Tdt Ctc 110m GGUF

--- license: cc-by-4.0 base_model: nvidia/parakeet-tdt_ctc-110m base_model_relation: quantized library_name: transcribe.cpp pipeline_tag: automatic-speech-recognition language: - en tags: - gguf - transcribe.cpp - asr - speech-to-text - parakeet - conformer - rnnt - tdt transcribe_cpp: wer_librispeech_test_clean: f32: 2.43 f16: 2.43 q8_0: 2.43 q6_k: 2.44 q5_k_m: 2.47 q4_k_m: 2.53 rtf_m4_max: metal: 347.5 cpu: 116 rtf_ryzen_4750u: vulkan: 32.5 cpu: 23.5 streaming: false translate: false lang_detect: false timestamps: token --- # parakeet-tdt_ctc-110m: transcribe.cpp GGUF GGUF conversions of [nvidia/parakeet-tdt_ctc-110m](https://huggingface.co/nvidia/parakeet-tdt_ctc-110m) for use with [transcribe.cpp](https://github.com/handy-computer/transcribe.cpp). Ported from upstream commit [431a349](https://huggingface.co/nvidia/parakeet-tdt_ctc-110m/commit/431a349), pinned 2026-05-10. Validated against the NeMo reference at transcribe.cpp commit [42528dd](https://github.com/handy-computer/transcribe.cpp/tree/42528dd) on 2026-05-10. Offline English speech-to-text with punctuation and capitalization. A 110M-parameter FastConformer encoder with a TDT/RNNT transducer decoder (the auxiliary CTC head from the upstream hybrid checkpoint is dropped at convert time). Not a streaming model and does not translate. ## Downloads | Quantization | Download | Size | WER (LibriSpeech test-clean) | | --- | --- | ---: | ---: | | F32 | [parakeet-tdt_ctc-110m-F32.gguf](https://huggingface.co/handy-computer/parakeet-tdt_ctc-110m-gguf/resolve/main/parakeet-tdt_ctc-110m-F32.gguf) | 457 MB | 2.43% | | F16 | [parakeet-tdt_ctc-110m-F16.gguf](https://huggingface.co/handy-computer/parakeet-tdt_ctc-110m-gguf/resolve/main/parakeet-tdt_ctc-110m-F16.gguf) | 229 MB | 2.43% | | Q8_0 | [parakeet-tdt_ctc-110m-Q8_0.gguf](https://huggingface.co/handy-computer/parakeet-tdt_ctc-110m-gguf/resolve/main/parakeet-tdt_ctc-110m-Q8_0.gguf) | 135 MB | 2.43% | | Q6_K | [parakeet-tdt_ctc-110m-Q6_K.gguf](https://huggingface.co/handy-computer/parakeet-tdt_ctc-110m-gguf/resolve/main/parakeet-tdt_ctc-110m-Q6_K.gguf) | 112 MB | 2.44% | | Q5_K_M | [parakeet-tdt_ctc-110m-Q5_K_M.gguf](https://huggingface.co/handy-computer/parakeet-tdt_ctc-110m-gguf/resolve/main/parakeet-tdt_ctc-110m-Q5_K_M.gguf) | 101 MB | 2.47% | | Q4_K_M | [parakeet-tdt_ctc-110m-Q4_K_M.gguf](https://huggingface.co/handy-co...

Source context: 2 downloads · 0 likes · Pipeline automatic-speech-recognition · Library transcribe.cpp · Repo memoravox/parakeet-tdt_ctc-110m-gguf