Skip to content

ModelListedExternal

Qwen3.5 0.8B GGUF

To run Qwen3.5 locally - Read our Guide!

Sourcehuggingface.co/Zombe123/Qwen3.5-0.8B-GGUF/tree/480952432cf24b8bd73297c4b57c3927e42f347a

KindOtherBase modelQwen/Qwen3.5-0.8BVersionRevision 4809524Cgrade

Model source

Kind: Other
File size: 195 MB–1.41 GB
Base model: Qwen/Qwen3.5-0.8B
Version: vRevision 4809524
Updated: Sep 18, 2026
Downloads: 124
Source: Hugging Face

Source excerpt

To run Qwen3.5 locally - Read our Guide!

Sources

1 source

Hugging FacePrimaryVersion 480952432cf24b8bd73297c4b57c3927e42f347a

huggingface.co/Zombe123/Qwen3.5-0.8B-GGUF/tree/480952432cf24b8bd73297c4b57c3927e42f347a

Verified Sep 3

Download files

Model artifacts

25 artifacts

mmproj-BF16.gguf

gguf · 198 MB · SHA-256 d312c4d02fd4…35d6 · Hugging Face

mmproj-F16.gguf

gguf · 195 MB · SHA-256 56e4c6cfe73b…2453 · Hugging Face

mmproj-F32.gguf

gguf · 384 MB · SHA-256 2b167b9d9a96…8da5 · Hugging Face

Qwen3.5-0.8B-BF16.gguf

gguf · 1.41 GB · SHA-256 cedf89af31c9…6ee5 · Hugging Face

Qwen3.5-0.8B-IQ4_NL.gguf

gguf · 483 MB · SHA-256 de9f7f28a415…1670 · Hugging Face

Qwen3.5-0.8B-IQ4_XS.gguf

gguf · 470 MB · SHA-256 619917ae92f6…36ff · Hugging Face

Qwen3.5-0.8B-Q3_K_M.gguf

gguf · 448 MB · SHA-256 c49ad509cd0a…b510 · Hugging Face

Qwen3.5-0.8B-Q3_K_S.gguf

gguf · 420 MB · SHA-256 4649ee78ff7c…3c39 · Hugging Face

Qwen3.5-0.8B-Q4_0.gguf

gguf · 484 MB · SHA-256 444406ddd926…652c · Hugging Face

Qwen3.5-0.8B-Q4_1.gguf

gguf · 510 MB · SHA-256 e5926ccfef0c…334e · Hugging Face

Qwen3.5-0.8B-Q4_K_M.gguf

gguf · 508 MB · SHA-256 bd258782e35f…c517 · Hugging Face

Qwen3.5-0.8B-Q4_K_S.gguf

gguf · 485 MB · SHA-256 5f7ccfa6e9df…6bc9 · Hugging Face

Qwen3.5-0.8B-Q5_K_M.gguf

gguf · 563 MB · SHA-256 c3ef5827b322…581b · Hugging Face

Qwen3.5-0.8B-Q5_K_S.gguf

gguf · 543 MB · SHA-256 a201a5899049…880f · Hugging Face

Qwen3.5-0.8B-Q6_K.gguf

gguf · 609 MB · SHA-256 8408c5c22211…098e · Hugging Face

Qwen3.5-0.8B-Q8_0.gguf

gguf · 774 MB · SHA-256 0ad885ffd4bb…7a6c · Hugging Face

Qwen3.5-0.8B-UD-IQ2_M.gguf

gguf · 355 MB · SHA-256 e31519c0ffb8…5134 · Hugging Face

Qwen3.5-0.8B-UD-IQ2_XXS.gguf

gguf · 323 MB · SHA-256 a369165c8ec4…3e54 · Hugging Face

Qwen3.5-0.8B-UD-IQ3_XXS.gguf

gguf · 380 MB · SHA-256 3dc1f2217751…5b8a · Hugging Face

Qwen3.5-0.8B-UD-Q2_K_XL.gguf

gguf · 398 MB · SHA-256 8d992fef3b0b…9909 · Hugging Face

Qwen3.5-0.8B-UD-Q3_K_XL.gguf

gguf · 469 MB · SHA-256 30a1353e67c9…a218 · Hugging Face

Qwen3.5-0.8B-UD-Q4_K_XL.gguf

gguf · 533 MB · SHA-256 3177ebd67afe…a7b5 · Hugging Face

Qwen3.5-0.8B-UD-Q5_K_XL.gguf

gguf · 578 MB · SHA-256 299824f81e5a…ee0e · Hugging Face

Qwen3.5-0.8B-UD-Q6_K_XL.gguf

gguf · 735 MB · SHA-256 8f0cb1e8e058…5684 · Hugging Face

Qwen3.5-0.8B-UD-Q8_K_XL.gguf

gguf · 1.10 GB · SHA-256 167183aecc07…2805 · Hugging Face

Source excerpts

2 excerpts

ReadmeSep 3huggingface.co/Zombe123/Qwen3.5-0.8B-GGUF

--- tags: - unsloth library_name: transformers license: apache-2.0 license_link: https://huggingface.co/Qwen/Qwen3.5-0.8B/blob/main/LICENSE pipeline_tag: image-text-to-text base_model: - Qwen/Qwen3.5-0.8B --- <div> <p style="margin-bottom: 0; margin-top: 0;"> <h1 style="margin-top: 0rem;">To run Qwen3.5 locally - <a href="https://unsloth.ai/docs/models/qwen3.5">Read our Guide!</a></h1> </p> <p style="margin-top: 0;margin-bottom: 0;"> <em><a href="https://unsloth.ai/docs/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em> </p> <div style="margin-top: 0;display: flex; gap: 5px; align-items: center; "> <a href="https://github.com/unslothai/unsloth/"> <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133"> </a> <a href="https://discord.gg/unsloth"> <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173"> </a> <a href="https://unsloth.ai/docs/models/qwen3.5"> <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143"> </a> </div> </div> - You can now also fine-tune the model locally with [Unsloth](https://github.com/unslothai/unsloth). - Read our [Qwen3.5 fine-tuning guide here](https://unsloth.ai/docs/models/qwen3.5/fine-tune). --- # Qwen3.5-0.8B <img width="400px" src="https://qianwen-res.oss-accelerate.aliyuncs.com/logo_qwen3.5.png"> [![Qwen Chat](https://img.shields.io/badge/%F0%9F%92%9C%EF%B8%8F%20Qwen%20Chat%20-536af5)](https://chat.qwen.ai) > [!Note] > This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format. > > These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc. > > In light of its parameter scale, the intended use cases are prototyping, task-specific fine-tuning, and other research or development purposes. Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with unprecedented capability and...

NoteSep 3huggingface.co/Zombe123/Qwen3.5-0.8B-GGUF

Source context: 124 downloads · 0 likes · Pipeline image-text-to-text · Library transformers · Repo Zombe123/Qwen3.5-0.8B-GGUF