Loading
Have a ComfyUI workflow? Get a readable Workflow Doc in your browser.Make a workflow readable.Try it now ↗
4bit MLX weight-only quantized variant of vanch007/mlx-MOSS-Transcribe-Diarize.
Model source
Source description
4bit MLX weight-only quantized variant of vanch007/mlx-MOSS-Transcribe-Diarize.
Quantization uses MLX affine quantization with bits=4 and group_size=64 on the text backbone, excluding the Whisper audio encoder and VQ adaptor.
Sources
1 sourceVerified Sep 22
Model artifacts
1 artifactSource excerpts
2 excerpts--- license: apache-2.0 library_name: mlx tags: - mlx - int4 - automatic-speech-recognition - speaker-diarization base_model: - vanch007/mlx-MOSS-Transcribe-Diarize pipeline_tag: automatic-speech-recognition --- # mlx-MOSS-Transcribe-Diarize 4bit 4bit MLX weight-only quantized variant of `vanch007/mlx-MOSS-Transcribe-Diarize`. Quantization uses MLX affine quantization with `bits=4` and `group_size=64` on the text backbone, excluding the Whisper audio encoder and VQ adaptor. ```bash python -m moss_transcribe_diarize.mlx.cli /path/to/input.wav \ --model vanch007/mlx-MOSS-Transcribe-Diarize-4bit \ --out-dir runs/mlx_4bit_example ```
python -m moss_transcribe_diarize.mlx.cli /path/to/input.wav \
--model vanch007/mlx-MOSS-Transcribe-Diarize-4bit \
--out-dir runs/mlx_4bit_example
Source context: 306 downloads · 0 likes · Pipeline automatic-speech-recognition · Library mlx · Repo vanch007/mlx-MOSS-Transcribe-Diarize-4bit