Qwen3.6 27B AutoRound MTP GGUF
This repository contains a GGUF release of the MTP version of Qwen/Qwen3.6-27B, quantized with Intel's AutoRound.
Model source
- Kind
- Other
- File size
- 9.68–18.2 GB
- Base model
- Qwen/Qwen3.6-27B
- Version
- vRevision 87701c9
- Updated
- Oct 6, 2026
- Publisher
- @OSEvohe
- Downloads
- 88
- Parameters
- 27B
- Source
- Hugging Face
Source description
Qwen3.6-27B MTP GGUF (AutoRound Quantized)
This repository contains a GGUF release of the MTP version of Qwen/Qwen3.6-27B, quantized with Intel's AutoRound.
Available Files
| File Name | Quant Type | Size |
|---|---|---|
Qwen3.6-27B-ATR-Q2_K_S.gguf | Q2_K_S | 9.67 GiB |
Qwen3.6-27B-ATR-Q2_K_MIXED.gguf | Q2_K_S | 10.83 GiB |
Qwen3.6-27B-ATR-Q3_K_M.gguf | Q3_K_M | 12.22 GiB |
Qwen3.6-27B-ATR-Q4_K_M.gguf | Q4_K_M | 15.65 GiB |
Qwen3.6-27B-ATR-Q5_K_M.gguf | Q5_K_M | 18.19 GiB |
Notes
- More quantizations may be added later.
Sources
1 source
Sources
1 sourceVerified Aug 27
Model artifacts
5 artifacts
Model artifacts
5 artifactsSource excerpts
3 excerpts
Source excerpts
3 excerpts--- base_model: Qwen/Qwen3.6-27B tags: - autoround - intel - gguf - quantization - mtp license: apache-2.0 --- # Qwen3.6-27B MTP GGUF (AutoRound Quantized) This repository contains a GGUF release of the **MTP** version of [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B), quantized with Intel's [AutoRound](https://github.com/intel/auto-round). ## Available Files | File Name | Quant Type | Size | |-----------|------------|------| | `Qwen3.6-27B-ATR-Q2_K_S.gguf` | Q2_K_S | 9.67 GiB | | `Qwen3.6-27B-ATR-Q2_K_MIXED.gguf` | Q2_K_S | 10.83 GiB | | `Qwen3.6-27B-ATR-Q3_K_M.gguf` | Q3_K_M | 12.22 GiB | | `Qwen3.6-27B-ATR-Q4_K_M.gguf` | Q4_K_M | 15.65 GiB | | `Qwen3.6-27B-ATR-Q5_K_M.gguf` | Q5_K_M | 18.19 GiB | ## Notes - More quantizations may be added later.
Source context: 88 downloads · 4 likes · Repo OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF
Source context: 364 downloads · 4 likes · Repo OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF
