GLM OCR OQ8 FP16
This model was quantized using oQ mixed-precision quantization.
Modellquelle
- Art
- Text model
- Dateigröße
- 1,48 GB
- Basismodell
- zai-org/GLM-OCR
- Version
- vmodel
- Aktualisiert
- 2. Nov. 2026
- Downloads
- 30
- Quelle
- Hugging Face
Quellenbeschreibung
GLM-OCR-oQ8-fp16
This model was quantized using oQ mixed-precision quantization.
float16 gives ~20% faster prefill on M1/M2 Apple Silicon (native fp16). bfloat16 is safer on M3/M4 and for numerical stability.
Benchmark (on M1 Max)
| Model Variant | PP (Tokens per second) | TG (Tokens per second) |
|---|---|---|
| Original (bf16) | 4,684 | 104.8 |
| oQ8-fp16 | 3,806 | 99.0 |
Quellen
1 Quelle
Quellen
1 QuelleVerifiziert 2. Nov.
Download files
Repository files
File inventory only; completeness is unverified.
Modellartefakte
1 Artefakt
Modellartefakte
1 ArtefaktQuellenauszüge
3 Auszüge
Quellenauszüge
3 Auszüge--- license: mit base_model: - zai-org/GLM-OCR pipeline_tag: image-to-text language: - zh - en - fr - es - ru - de - ja - ko tags: - mlx - oq - quantized library_name: mlx --- # GLM-OCR-oQ8-fp16 This model was quantized using [oQ](https://github.com/jundot/omlx) mixed-precision quantization. float16 gives ~20% faster prefill on M1/M2 Apple Silicon (native fp16). bfloat16 is safer on M3/M4 and for numerical stability. # Benchmark (on M1 Max) | Model Variant | PP (Tokens per second) | TG (Tokens per second) | | :--- | :---: | :---: | | Original (bf16) | 4,684 | 104.8 | | oQ8-fp16 | 3,806 | 99.0 |
Source context: 30 downloads · 3 likes · Pipeline image-to-text · Library mlx · Repo RepublicOfKorokke/GLM-OCR-oQ8-fp16
Source context: 69 downloads · 3 likes · Pipeline image-to-text · Library mlx · Repo RepublicOfKorokke/GLM-OCR-oQ8-fp16
