ModelÜberprüftExtern

GLM 4.6V MXFP4 MoE GGUF

This is a imatrix MXFP4MOE quantization of the model GLM-4.6V, based on the imatrix from unsloth.

Quellehuggingface.co/jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF/tree/d5af51efdac0130eaf4454c9362b2833e40cbb7b

ArtOtherBasismodellzai-org/GLM-4.6VVersionRevision d5af51eVerleger@jamiefutchCBewertung

Modellquelle

Art: Other
Dateigröße: 948 MB–14,7 GB
Basismodell: zai-org/GLM-4.6V
Version: vRevision d5af51e
Aktualisiert: 4. Okt. 2026
Verleger: @jamiefutch
Downloads: 61
Quelle: Hugging Face

Quellenbeschreibung

This is a imatrix MXFP4_MOE quantization of the model GLM-4.6V, based on the imatrix from unsloth.

Get the latest llama.cpp in order to run it.

For the mmproj, try to use the largest version you can fit in memory in order to get the best results.
F32 > BF16 > F16 > Q8_0.

Quellen

1 Quelle

Hugging FacePrimärVersion d5af51efdac0130eaf4454c9362b2833e40cbb7b

huggingface.co/jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF/tree/d5af51efdac0130eaf4454c9362b2833e40cbb7b

Verifiziert 4. Okt.

Modellartefakte

8 Artefakte

GLM-4.6V-MXFP4_MOE-00001-of-00004.gguf

gguf · 14,6 GB · SHA-256 a93f792301f6…53da · Hugging Face

Herunterladen

GLM-4.6V-MXFP4_MOE-00002-of-00004.gguf

gguf · 14,7 GB · SHA-256 a7d93eccf8ee…92e4 · Hugging Face

Herunterladen

GLM-4.6V-MXFP4_MOE-00003-of-00004.gguf

gguf · 14,7 GB · SHA-256 b9b09b4b6e53…9a9b · Hugging Face

Herunterladen

GLM-4.6V-MXFP4_MOE-00004-of-00004.gguf

gguf · 12,6 GB · SHA-256 596dba45fc40…f361 · Hugging Face

Herunterladen

mmproj-BF16.gguf

gguf · 1,65 GB · SHA-256 5ad73809d750…35d2 · Hugging Face

Herunterladen

mmproj-F16.gguf

gguf · 1,60 GB · SHA-256 d3c5b2a5089b…29a2 · Hugging Face

Herunterladen

mmproj-F32.gguf

gguf · 3,20 GB · SHA-256 ec76cf75dfd9…ed41 · Hugging Face

Herunterladen

mmproj-Q8_0.gguf

gguf · 948 MB · SHA-256 b1edd7b50526…6931 · Hugging Face

Herunterladen

Quellenauszüge

3 Auszüge

Readme11. Julihuggingface.co/jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF

--- pipeline_tag: image-text-to-text base_model: - zai-org/GLM-4.6V --- This is a imatrix MXFP4_MOE quantization of the model [GLM-4.6V](https://huggingface.co/zai-org/GLM-4.6V), based on the imatrix from unsloth. Get the latest [llama.cpp](https://github.com/ggml-org/llama.cpp/releases) in order to run it. For the mmproj, try to use the largest version you can fit in memory in order to get the best results. F32 > BF16 > F16 > Q8_0.

Note4. Okt.huggingface.co/jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF

Source context: 61 downloads · 2 likes · Pipeline image-text-to-text · Repo jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF

Note18. Julihuggingface.co/jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF

Source context: 210 downloads · 2 likes · Pipeline image-text-to-text · Repo jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF