--- pipeline_tag: image-text-to-text base_model: - zai-org/GLM-4.6V --- This is a imatrix MXFP4_MOE quantization of the model [GLM-4.6V](https://huggingface.co/zai-org/GLM-4.6V), based on the imatrix from unsloth. Get the latest [llama.cpp](https://github.com/ggml-org/llama.cpp/releases) in order to run it. For the mmproj, try to use the largest version you can fit in memory in order to get the best results. F32 > BF16 > F16 > Q8_0.
pipelinetag: image-text-to-text basemodel: zai-org/GLM-4.6V This is a imatrix MXFP4MOE quantization of the model GLM-4.6V, based on the imatrix from unsloth.
