Skip to content
ModelVerifiedExternal
Download

Qwen3.6 27B AutoRound MTP GGUF

This repository contains a GGUF release of the MTP version of Qwen/Qwen3.6-27B, quantized with Intel's AutoRound.

KindOtherBase modelQwen/Qwen3.6-27BVersionRevision 87701c9Publisher@OSEvoheCgrade

Model source

Kind
Other
File size
9.68–18.2 GB
Base model
Qwen/Qwen3.6-27B
Version
vRevision 87701c9
Updated
Oct 6, 2026
Publisher
@OSEvohe
Downloads
88
Parameters
27B
Source
Hugging Face

Source description

Qwen3.6-27B MTP GGUF (AutoRound Quantized)

This repository contains a GGUF release of the MTP version of Qwen/Qwen3.6-27B, quantized with Intel's AutoRound.

Available Files

File NameQuant TypeSize
Qwen3.6-27B-ATR-Q2_K_S.ggufQ2_K_S9.67 GiB
Qwen3.6-27B-ATR-Q2_K_MIXED.ggufQ2_K_S10.83 GiB
Qwen3.6-27B-ATR-Q3_K_M.ggufQ3_K_M12.22 GiB
Qwen3.6-27B-ATR-Q4_K_M.ggufQ4_K_M15.65 GiB
Qwen3.6-27B-ATR-Q5_K_M.ggufQ5_K_M18.19 GiB

Notes

  • More quantizations may be added later.

Sources

1 source
Hugging FacePrimaryVersion 87701c94d3b0ef501d92b4205ab8581436ee337d
huggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF/tree/87701c94d3b0ef501d92b4205ab8581436ee337d

Verified Aug 27

Model artifacts

5 artifacts

Qwen3.6-27B-ATR-Q2_K_MIXED.gguf

gguf · 10.8 GB · SHA-256 240f8fe86d44…c7fe · Hugging Face

Download

Qwen3.6-27B-ATR-Q2_K_S.gguf

gguf · 9.68 GB · SHA-256 eb6b349c010c…a13a · Hugging Face

Download

Qwen3.6-27B-ATR-Q3_K_M.gguf

gguf · 12.2 GB · SHA-256 9ade34975bff…f49f · Hugging Face

Download

Qwen3.6-27B-ATR-Q4_K_M.gguf

gguf · 15.7 GB · SHA-256 edbfc550222c…0bf6 · Hugging Face

Download

Qwen3.6-27B-ATR-Q5_K_M.gguf

gguf · 18.2 GB · SHA-256 5f46325a9701…bebe · Hugging Face

Download

Source excerpts

3 excerpts

--- base_model: Qwen/Qwen3.6-27B tags: - autoround - intel - gguf - quantization - mtp license: apache-2.0 --- # Qwen3.6-27B MTP GGUF (AutoRound Quantized) This repository contains a GGUF release of the **MTP** version of [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B), quantized with Intel's [AutoRound](https://github.com/intel/auto-round). ## Available Files | File Name | Quant Type | Size | |-----------|------------|------| | `Qwen3.6-27B-ATR-Q2_K_S.gguf` | Q2_K_S | 9.67 GiB | | `Qwen3.6-27B-ATR-Q2_K_MIXED.gguf` | Q2_K_S | 10.83 GiB | | `Qwen3.6-27B-ATR-Q3_K_M.gguf` | Q3_K_M | 12.22 GiB | | `Qwen3.6-27B-ATR-Q4_K_M.gguf` | Q4_K_M | 15.65 GiB | | `Qwen3.6-27B-ATR-Q5_K_M.gguf` | Q5_K_M | 18.19 GiB | ## Notes - More quantizations may be added later.

Source context: 88 downloads · 4 likes · Repo OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

Source context: 364 downloads · 4 likes · Repo OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF