Ir para o conteúdo
ModelVerificadoExterno
Baixar

Qwen3.6 27B AutoRound MTP GGUF

This repository contains a GGUF release of the MTP version of Qwen/Qwen3.6-27B, quantized with Intel's AutoRound.

TipoOtherModelo baseQwen/Qwen3.6-27BVersãoRevision 87701c9Publicador@OSEvoheCnota

Fonte do modelo

Tipo
Other
Tamanho do arquivo
9,68–18,2 GB
Modelo base
Qwen/Qwen3.6-27B
Versão
vRevision 87701c9
Atualizado
6 de out. de 2026
Publicador
@OSEvohe
Downloads
88
Parâmetros
27B
Fonte
Hugging Face

Descrição da fonte

Qwen3.6-27B MTP GGUF (AutoRound Quantized)

This repository contains a GGUF release of the MTP version of Qwen/Qwen3.6-27B, quantized with Intel's AutoRound.

Available Files

File NameQuant TypeSize
Qwen3.6-27B-ATR-Q2_K_S.ggufQ2_K_S9.67 GiB
Qwen3.6-27B-ATR-Q2_K_MIXED.ggufQ2_K_S10.83 GiB
Qwen3.6-27B-ATR-Q3_K_M.ggufQ3_K_M12.22 GiB
Qwen3.6-27B-ATR-Q4_K_M.ggufQ4_K_M15.65 GiB
Qwen3.6-27B-ATR-Q5_K_M.ggufQ5_K_M18.19 GiB

Notes

  • More quantizations may be added later.

Fontes

1 fonte
Hugging FacePrimárioVersão 87701c94d3b0ef501d92b4205ab8581436ee337d
huggingface.co/OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF/tree/87701c94d3b0ef501d92b4205ab8581436ee337d

Verificado 27 de ago.

Artefatos de modelo

5 artefatos

Qwen3.6-27B-ATR-Q2_K_MIXED.gguf

gguf · 10,8 GB · SHA-256 240f8fe86d44…c7fe · Hugging Face

Baixar

Qwen3.6-27B-ATR-Q2_K_S.gguf

gguf · 9,68 GB · SHA-256 eb6b349c010c…a13a · Hugging Face

Baixar

Qwen3.6-27B-ATR-Q3_K_M.gguf

gguf · 12,2 GB · SHA-256 9ade34975bff…f49f · Hugging Face

Baixar

Qwen3.6-27B-ATR-Q4_K_M.gguf

gguf · 15,7 GB · SHA-256 edbfc550222c…0bf6 · Hugging Face

Baixar

Qwen3.6-27B-ATR-Q5_K_M.gguf

gguf · 18,2 GB · SHA-256 5f46325a9701…bebe · Hugging Face

Baixar

Trechos de fonte

3 trechos

--- base_model: Qwen/Qwen3.6-27B tags: - autoround - intel - gguf - quantization - mtp license: apache-2.0 --- # Qwen3.6-27B MTP GGUF (AutoRound Quantized) This repository contains a GGUF release of the **MTP** version of [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B), quantized with Intel's [AutoRound](https://github.com/intel/auto-round). ## Available Files | File Name | Quant Type | Size | |-----------|------------|------| | `Qwen3.6-27B-ATR-Q2_K_S.gguf` | Q2_K_S | 9.67 GiB | | `Qwen3.6-27B-ATR-Q2_K_MIXED.gguf` | Q2_K_S | 10.83 GiB | | `Qwen3.6-27B-ATR-Q3_K_M.gguf` | Q3_K_M | 12.22 GiB | | `Qwen3.6-27B-ATR-Q4_K_M.gguf` | Q4_K_M | 15.65 GiB | | `Qwen3.6-27B-ATR-Q5_K_M.gguf` | Q5_K_M | 18.19 GiB | ## Notes - More quantizations may be added later.

Source context: 88 downloads · 4 likes · Repo OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

Source context: 364 downloads · 4 likes · Repo OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF