ModelVerificadoExterno

GLM 4.6V MXFP4 MoE GGUF

This is a imatrix MXFP4MOE quantization of the model GLM-4.6V, based on the imatrix from unsloth.

Fontehuggingface.co/jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF/tree/d5af51efdac0130eaf4454c9362b2833e40cbb7b

TipoOtherModelo basezai-org/GLM-4.6VVersãoRevision d5af51ePublicador@jamiefutchCnota

Fonte do modelo

Tipo: Other
Tamanho do arquivo: 948 MB–14,7 GB
Modelo base: zai-org/GLM-4.6V
Versão: vRevision d5af51e
Atualizado: 4 de out. de 2026
Publicador: @jamiefutch
Downloads: 61
Fonte: Hugging Face

Descrição da fonte

This is a imatrix MXFP4_MOE quantization of the model GLM-4.6V, based on the imatrix from unsloth.

Get the latest llama.cpp in order to run it.

For the mmproj, try to use the largest version you can fit in memory in order to get the best results.
F32 > BF16 > F16 > Q8_0.

Fontes

1 fonte

Hugging FacePrimárioVersão d5af51efdac0130eaf4454c9362b2833e40cbb7b

huggingface.co/jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF/tree/d5af51efdac0130eaf4454c9362b2833e40cbb7b

Verificado 4 de out.

Artefatos de modelo

8 artefatos

GLM-4.6V-MXFP4_MOE-00001-of-00004.gguf

gguf · 14,6 GB · SHA-256 a93f792301f6…53da · Hugging Face

Baixar

GLM-4.6V-MXFP4_MOE-00002-of-00004.gguf

gguf · 14,7 GB · SHA-256 a7d93eccf8ee…92e4 · Hugging Face

Baixar

GLM-4.6V-MXFP4_MOE-00003-of-00004.gguf

gguf · 14,7 GB · SHA-256 b9b09b4b6e53…9a9b · Hugging Face

Baixar

GLM-4.6V-MXFP4_MOE-00004-of-00004.gguf

gguf · 12,6 GB · SHA-256 596dba45fc40…f361 · Hugging Face

Baixar

mmproj-BF16.gguf

gguf · 1,65 GB · SHA-256 5ad73809d750…35d2 · Hugging Face

Baixar

mmproj-F16.gguf

gguf · 1,60 GB · SHA-256 d3c5b2a5089b…29a2 · Hugging Face

Baixar

mmproj-F32.gguf

gguf · 3,20 GB · SHA-256 ec76cf75dfd9…ed41 · Hugging Face

Baixar

mmproj-Q8_0.gguf

gguf · 948 MB · SHA-256 b1edd7b50526…6931 · Hugging Face

Baixar

Trechos de fonte

3 trechos

Readme11 de jul.huggingface.co/jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF

--- pipeline_tag: image-text-to-text base_model: - zai-org/GLM-4.6V --- This is a imatrix MXFP4_MOE quantization of the model [GLM-4.6V](https://huggingface.co/zai-org/GLM-4.6V), based on the imatrix from unsloth. Get the latest [llama.cpp](https://github.com/ggml-org/llama.cpp/releases) in order to run it. For the mmproj, try to use the largest version you can fit in memory in order to get the best results. F32 > BF16 > F16 > Q8_0.

Note4 de out.huggingface.co/jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF

Source context: 61 downloads · 2 likes · Pipeline image-text-to-text · Repo jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF

Note18 de jul.huggingface.co/jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF

Source context: 210 downloads · 2 likes · Pipeline image-text-to-text · Repo jamiefutch/GLM-4.6V-MXFP4_MOE-GGUF