Cohere Transcribe Mlx 8bit

--- library_name: mlx tags: - mlx - automatic-speech-recognition - audio - speech-recognition - transcription - cohere_asr - custom_code language: - multilingual license: apache-2.0 pipeline_tag: automatic-speech-recognition base_model: CohereLabs/cohere-transcribe-03-2026 base_model_relation: quantized --- # littoralai/cohere-transcribe-mlx-8bit 8-bit MLX quantization of [CohereLabs/cohere-transcribe-03-2026](https://huggingface.co/CohereLabs/cohere-transcribe-03-2026), via the MLX fp16 conversion at [littoralai/cohere-transcribe-mlx-fp16](https://huggingface.co/littoralai/cohere-transcribe-mlx-fp16). Quantized with mlx-audio (8-bit, group size 64, affine). No architecture, vocabulary, or training changes. See the base model card for capabilities, training details, and evaluations. ## License Apache-2.0, from the base model. The custom architecture code (`modeling_cohere_asr.py`, `configuration_cohere_asr.py`, `processing_cohere_asr.py`, `tokenization_cohere_asr.py`) is Cohere's, redistributed unchanged. Changes vs. the source: fp16 MLX conversion, then 8-bit affine quantization. ## Integrity `model.safetensors` sha256 `aadaf8d3388975853385400c9bd8dee92a71e12a83860f35bebaac345aa8af93` ## Use with mlx-audio ```bash python -m mlx_audio.stt.generate --model littoralai/cohere-transcribe-mlx-8bit \ --audio audio.wav --output out ```

Source context: 134 downloads · 0 likes · Pipeline automatic-speech-recognition · Library mlx · Repo littoralai/cohere-transcribe-mlx-8bit