Nemotron Speech Streaming En 0.6b GGUF

--- license: other license_name: nvidia-open-model-license license_link: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/ base_model: nvidia/nemotron-speech-streaming-en-0.6b base_model_relation: quantized library_name: transcribe.cpp pipeline_tag: automatic-speech-recognition language: - en tags: - gguf - transcribe.cpp - asr - speech-to-text - parakeet - conformer - rnnt - streaming - cache-aware transcribe_cpp: wer_librispeech_test_clean: f32: 2.31 f16: 2.31 q8_0: 2.31 q6_k: 2.29 q5_k_m: 2.34 q4_k_m: 2.38 rtf_m4_max: metal: 154.5 cpu: 32 rtf_ryzen_4750u: vulkan: 13 cpu: 7.5 streaming: true translate: false lang_detect: false timestamps: token --- # nemotron-speech-streaming-en-0.6b: transcribe.cpp GGUF GGUF conversions of [nvidia/nemotron-speech-streaming-en-0.6b](https://huggingface.co/nvidia/nemotron-speech-streaming-en-0.6b) for use with [transcribe.cpp](https://github.com/handy-computer/transcribe.cpp). Ported from upstream commit [ef3bf40](https://huggingface.co/nvidia/nemotron-speech-streaming-en-0.6b/commit/ef3bf40), pinned 2026-05-11. Validated against the NeMo reference at transcribe.cpp commit [12f1076](https://github.com/handy-computer/transcribe.cpp/tree/12f1076) on 2026-05-11. Offline English speech-to-text with punctuation and capitalization. A 0.6B-parameter cache-aware streaming FastConformer encoder with an RNN-T transducer decoder. Runs in offline mode. The encoder preserves the upstream att_context_size=[70, 13] (1.12s) cache-aware attention mask end-to-end. transcribe.cpp does not yet expose a streaming session API. ## Downloads | Quantization | Download | Size | WER (LibriSpeech test-clean, offline) | | --- | --- | ---: | ---: | | F32 | [nemotron-speech-streaming-en-0.6b-F32.gguf](https://huggingface.co/handy-computer/nemotron-speech-streaming-en-0.6b-gguf/resolve/main/nemotron-speech-streaming-en-0.6b-F32.gguf) | 2.30 GB | 2.31% | | F16 | [nemotron-speech-streaming-en-0.6b-F16.gguf](https://huggingface.co/handy-computer/nemotron-speech-streaming-en-0.6b-gguf/resolve/main/nemotron-speech-streaming-en-0.6b-F16.gguf) | 1.16 GB | 2.31% | | Q8_0 | [nemotron-speech-streaming-en-0.6b-Q8_0.gguf](https://huggingface.co/handy-computer/nemotron-speech-streaming-en-0.6b-gguf/resolve/main/nemotron-speech-streaming-en-0.6b-Q8_0.gguf) | 696 MB | 2.31% | | Q6_K | [nemotron-spe...

Source context: 18 downloads · 0 likes · Pipeline automatic-speech-recognition · Library transcribe.cpp · Repo memoravox/nemotron-speech-streaming-en-0.6b-gguf