ModelÜberprüftExtern

Qwen3.6 27B AutoRound MTP GGUF

This repository contains a GGUF release of the MTP version of Qwen/Qwen3.6-27B, quantized with Intel's AutoRound.

Quellehuggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF/tree/87701c94d3b0ef501d92b4205ab8581436ee337d

ArtOtherBasismodellQwen/Qwen3.6-27BVersionRevision 87701c9Verleger@OSEvoheCBewertung

Modellquelle

Art: Other
Dateigröße: 9,68–18,2 GB
Basismodell: Qwen/Qwen3.6-27B
Version: vRevision 87701c9
Aktualisiert: 6. Okt. 2026
Verleger: @OSEvohe
Downloads: 88
Parameter: 27B
Quelle: Hugging Face

Quellenbeschreibung

Qwen3.6-27B MTP GGUF (AutoRound Quantized)

This repository contains a GGUF release of the MTP version of Qwen/Qwen3.6-27B, quantized with Intel's AutoRound.

Available Files

File Name	Quant Type	Size
`Qwen3.6-27B-ATR-Q2_K_S.gguf`	Q2_K_S	9.67 GiB
`Qwen3.6-27B-ATR-Q2_K_MIXED.gguf`	Q2_K_S	10.83 GiB
`Qwen3.6-27B-ATR-Q3_K_M.gguf`	Q3_K_M	12.22 GiB
`Qwen3.6-27B-ATR-Q4_K_M.gguf`	Q4_K_M	15.65 GiB
`Qwen3.6-27B-ATR-Q5_K_M.gguf`	Q5_K_M	18.19 GiB

Notes

More quantizations may be added later.

Quellen

1 Quelle

Hugging FacePrimärVersion 87701c94d3b0ef501d92b4205ab8581436ee337d

huggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF/tree/87701c94d3b0ef501d92b4205ab8581436ee337d

Verifiziert 27. Aug.

Modellartefakte

5 Artefakte

Qwen3.6-27B-ATR-Q2_K_MIXED.gguf

gguf · 10,8 GB · SHA-256 240f8fe86d44…c7fe · Hugging Face

Herunterladen

Qwen3.6-27B-ATR-Q2_K_S.gguf

gguf · 9,68 GB · SHA-256 eb6b349c010c…a13a · Hugging Face

Herunterladen

Qwen3.6-27B-ATR-Q3_K_M.gguf

gguf · 12,2 GB · SHA-256 9ade34975bff…f49f · Hugging Face

Herunterladen

Qwen3.6-27B-ATR-Q4_K_M.gguf

gguf · 15,7 GB · SHA-256 edbfc550222c…0bf6 · Hugging Face

Herunterladen

Qwen3.6-27B-ATR-Q5_K_M.gguf

gguf · 18,2 GB · SHA-256 5f46325a9701…bebe · Hugging Face

Herunterladen

Quellenauszüge

3 Auszüge

Readme11. Julihuggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

--- base_model: Qwen/Qwen3.6-27B tags: - autoround - intel - gguf - quantization - mtp license: apache-2.0 --- # Qwen3.6-27B MTP GGUF (AutoRound Quantized) This repository contains a GGUF release of the **MTP** version of [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B), quantized with Intel's [AutoRound](https://github.com/intel/auto-round). ## Available Files | File Name | Quant Type | Size | |-----------|------------|------| | `Qwen3.6-27B-ATR-Q2_K_S.gguf` | Q2_K_S | 9.67 GiB | | `Qwen3.6-27B-ATR-Q2_K_MIXED.gguf` | Q2_K_S | 10.83 GiB | | `Qwen3.6-27B-ATR-Q3_K_M.gguf` | Q3_K_M | 12.22 GiB | | `Qwen3.6-27B-ATR-Q4_K_M.gguf` | Q4_K_M | 15.65 GiB | | `Qwen3.6-27B-ATR-Q5_K_M.gguf` | Q5_K_M | 18.19 GiB | ## Notes - More quantizations may be added later.

Note27. Aug.huggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

Source context: 88 downloads · 4 likes · Repo OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

Note17. Julihuggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

Source context: 364 downloads · 4 likes · Repo OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF