GLM 5.2 Q4 K M GGUF

--- base_model: zai-org/GLM-5.2 language: - en - zh library_name: transformers license: mit pipeline_tag: text-generation tags: - gguf - quantized - llama.cpp - glm --- # GLM-5.2 (Q4_K_M GGUF) This repository contains the **Q4_K_M quantized GGUF** version of [Z.ai's GLM-5.2](https://huggingface.co/zai-org/GLM-5.2). Due to the size of the model, the GGUF has been split into 8 parts: * `GLM-5.2-Q4_K_M-00001-of-00008.gguf` * `GLM-5.2-Q4_K_M-00002-of-00008.gguf` * `...` * `GLM-5.2-Q4_K_M-00008-of-00008.gguf` ### How to use split GGUF files To run this model, you need to download all 8 files into the same directory. Modern versions of [llama.cpp](https://github.com/ggerganov/llama.cpp) and compatible UIs (like LM Studio, Ollama, or text-generation-webui) will automatically detect and load all parts as long as you point them to the first file. **Using `llama.cpp` via CLI:** ```bash ./llama-cli -m models/GLM-5.2-Q4_K_M-00001-of-00008.gguf -p "Your prompt here" -n 512 ``` *(Alternatively, you can merge them back into a single file using the `llama-gguf-split` tool provided with llama.cpp, though it is not strictly necessary).* --- *The following is the original model card information for GLM-5.2:* <div align="center"> <img src=https://raw.githubusercontent.com/zai-org/GLM-5/refs/heads/main/resources/logo.svg width="15%"/> </div> <p align="center"> 👋 Join our <a href="https://raw.githubusercontent.com/zai-org/GLM-5/refs/heads/main/resources/wechat.png" target="_blank">WeChat</a> or <a href="https://discord.gg/QR7SARHRxK" target="_blank">Discord</a> community. <br> 📖 Check out the GLM-5.2 <a href="https://z.ai/blog/glm-5.2" target="_blank">blog</a> and GLM-5 <a href="https://arxiv.org/abs/2602.15763" target="_blank">Technical report</a>. <br> 📍 Use GLM-5.2 API services on <a href="https://docs.z.ai/guides/llm/glm-5.2">Z.ai API Platform. </a> <br> 🔜 Try GLM-5.2 <a href="https://chat.z.ai">here</a>. </p> <p align="center"> [<a href="https://huggingface.co/papers/2602.15763" target="_blank">Paper</a>] [<a href="https://github.com/zai-org/GLM-5" target="_blank">GitHub</a>] </p> ## Introduction We're introducing GLM-5.2, our latest flagship model for long-horizon tasks. It marks a substantial leap in long-horizon task capability over its predecessor GLM-5.1 and, for the first time, delivers that capability on a **solid 1M-token context**. GLM-5....

Source context: 219 downloads · 11 likes · Pipeline text-generation · Library transformers · Repo Abiray/GLM-5.2-Q4_K_M-GGUF

Source context: 5732 downloads · 11 likes · Pipeline text-generation · Library transformers · Repo Abiray/GLM-5.2-Q4_K_M-GGUF