Nemotron 3.5 Asr Streaming 0.6b GGUF

--- license: other license_name: openmdw-1.1 license_link: https://huggingface.co/nvidia/nemotron-3.5-asr-streaming-0.6b base_model: nvidia/nemotron-3.5-asr-streaming-0.6b base_model_relation: quantized library_name: transcribe.cpp pipeline_tag: automatic-speech-recognition language: - en - es - fr - it - pt - nl - de - tr - ru - ar - hi - ja - ko - vi - uk - pl - sv - cs - nb - da - bg - fi - hr - sk - zh - hu - ro - et tags: - gguf - transcribe.cpp - asr - speech-to-text - parakeet - conformer - rnnt - streaming - cache-aware - multilingual transcribe_cpp: wer_fleurs_en: f32: 7.97 f16: 7.97 q8_0: 7.88 q6_k: 8.02 q5_k_m: 8.15 q4_k_m: 8.49 wer_librispeech_test_clean: f32: 3.04 f16: 3.03 q8_0: 3.06 q6_k: 3.07 q5_k_m: 3.1 q4_k_m: 3.28 rtf_m4_max: metal: 98 cpu: 29 rtf_ryzen_4750u: vulkan: 14.5 cpu: 7.5 streaming: true translate: false lang_detect: true timestamps: token --- # nemotron-3.5-asr-streaming-0.6b: transcribe.cpp GGUF GGUF conversions of [nvidia/nemotron-3.5-asr-streaming-0.6b](https://huggingface.co/nvidia/nemotron-3.5-asr-streaming-0.6b) for use with [transcribe.cpp](https://github.com/handy-computer/transcribe.cpp). Ported from upstream commit [24b151a](https://huggingface.co/nvidia/nemotron-3.5-asr-streaming-0.6b/commit/24b151a), pinned 2026-06-08. Validated against the NeMo reference at transcribe.cpp commit [909e94e](https://github.com/handy-computer/transcribe.cpp/tree/909e94e) on 2026-06-08. Multilingual speech-to-text across 32 supported language-locales (the model's tokenizer recognizes 40, but 8 are adaptation-ready and need fine-tuning) with punctuation and capitalization. A 0.6B-parameter cache-aware streaming FastConformer encoder with a prompt-conditioned RNN-T transducer decoder; the target language is selected per call (--language en-US, fr-FR, de-DE, ...) and an auto mode emits a <lang-XX> tag. Ships both the offline path (att_context_size=[56, 13], 1.12s, headline accuracy) and runtime-selectable chunked streaming (--stream-chunk-ms 1120 --stream-att-right {0,3,6,13}). ## Downloads | Quantization | Download | Size | WER (FLEURS test en (en-US), offline att_context_size=[56, 13]) | | --- | --- | ---: | ---: | | F32 | [nemotron-3.5-asr-streaming-0.6b-F32.gguf](https://huggingface.co/handy-computer/nemotron-3.5-asr-streaming-0.6b-gguf/resolve/main/nemotron-3.5-asr-...

Source context: 52 downloads · 0 likes · Pipeline automatic-speech-recognition · Library transcribe.cpp · Repo memoravox/nemotron-3.5-asr-streaming-0.6b-gguf