ModelVérifiéExterne

Qwen3.6 27B AutoRound MTP GGUF

This repository contains a GGUF release of the MTP version of Qwen/Qwen3.6-27B, quantized with Intel's AutoRound.

Sourcehuggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF/tree/87701c94d3b0ef501d92b4205ab8581436ee337d

TypeOtherModèle de baseQwen/Qwen3.6-27BVersionRevision 87701c9Éditeur@OSEvoheCClasse

Source du modèle

Type: Other
Taille du fichier: 9,68–18,2 GB
Modèle de base: Qwen/Qwen3.6-27B
Version: vRevision 87701c9
Mis à jour: 6 oct. 2026
Éditeur: @OSEvohe
Téléchargements: 88
Paramètres: 27B
Source: Hugging Face

Description de la source

Qwen3.6-27B MTP GGUF (AutoRound Quantized)

This repository contains a GGUF release of the MTP version of Qwen/Qwen3.6-27B, quantized with Intel's AutoRound.

Available Files

File Name	Quant Type	Size
`Qwen3.6-27B-ATR-Q2_K_S.gguf`	Q2_K_S	9.67 GiB
`Qwen3.6-27B-ATR-Q2_K_MIXED.gguf`	Q2_K_S	10.83 GiB
`Qwen3.6-27B-ATR-Q3_K_M.gguf`	Q3_K_M	12.22 GiB
`Qwen3.6-27B-ATR-Q4_K_M.gguf`	Q4_K_M	15.65 GiB
`Qwen3.6-27B-ATR-Q5_K_M.gguf`	Q5_K_M	18.19 GiB

Notes

More quantizations may be added later.

Sources

1 source

Hugging FacePrincipalVersion 87701c94d3b0ef501d92b4205ab8581436ee337d

huggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF/tree/87701c94d3b0ef501d92b4205ab8581436ee337d

Vérifié 27 août

Artefacts du modèle

5 artefacts

Qwen3.6-27B-ATR-Q2_K_MIXED.gguf

gguf · 10,8 GB · SHA-256 240f8fe86d44…c7fe · Hugging Face

Télécharger

Qwen3.6-27B-ATR-Q2_K_S.gguf

gguf · 9,68 GB · SHA-256 eb6b349c010c…a13a · Hugging Face

Télécharger

Qwen3.6-27B-ATR-Q3_K_M.gguf

gguf · 12,2 GB · SHA-256 9ade34975bff…f49f · Hugging Face

Télécharger

Qwen3.6-27B-ATR-Q4_K_M.gguf

gguf · 15,7 GB · SHA-256 edbfc550222c…0bf6 · Hugging Face

Télécharger

Qwen3.6-27B-ATR-Q5_K_M.gguf

gguf · 18,2 GB · SHA-256 5f46325a9701…bebe · Hugging Face

Télécharger

Extraits de sources

3 extraits

Readme11 juil.huggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

--- base_model: Qwen/Qwen3.6-27B tags: - autoround - intel - gguf - quantization - mtp license: apache-2.0 --- # Qwen3.6-27B MTP GGUF (AutoRound Quantized) This repository contains a GGUF release of the **MTP** version of [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B), quantized with Intel's [AutoRound](https://github.com/intel/auto-round). ## Available Files | File Name | Quant Type | Size | |-----------|------------|------| | `Qwen3.6-27B-ATR-Q2_K_S.gguf` | Q2_K_S | 9.67 GiB | | `Qwen3.6-27B-ATR-Q2_K_MIXED.gguf` | Q2_K_S | 10.83 GiB | | `Qwen3.6-27B-ATR-Q3_K_M.gguf` | Q3_K_M | 12.22 GiB | | `Qwen3.6-27B-ATR-Q4_K_M.gguf` | Q4_K_M | 15.65 GiB | | `Qwen3.6-27B-ATR-Q5_K_M.gguf` | Q5_K_M | 18.19 GiB | ## Notes - More quantizations may be added later.

Note27 aoûthuggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

Source context: 88 downloads · 4 likes · Repo OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

Note17 juil.huggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

Source context: 364 downloads · 4 likes · Repo OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF