Saltar al contenido
ModelVerificadoExterno
Descargar

Gemma4 31b Gembrain Equinox I1 GGUF

For a convenient overview and download list, visit our model page for this model.

Fuentehuggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF/tree/06ad9c27686ab2935301d5f7953a638d1a0a49aa
TipoOtherModelo baserpDungeon/Gemma4-31b-Gembrain-EquinoxVersiónRevision 06ad9c2Publicador@mradermacherCcalidad

Fuente del modelo

Tipo
Other
Tamaño del archivo
13,1 MB–23,5 GB
Modelo base
rpDungeon/Gemma4-31b-Gembrain-Equinox
Versión
vRevision 06ad9c2
Actualizado
3 oct 2026
Publicador
@mradermacher
Descargas
1,6 mil
Parámetros
31B
Fuente
Hugging Face

Descripción de la fuente

About

weighted/imatrix quants of https://huggingface.co/rpDungeon/Gemma4-31b-Gembrain-Equinox

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-GGUF

This is a vision model - mmproj files (if any) will be in the static repository.

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

LinkTypeSize/GBNotes
GGUFimatrix0.1imatrix file (for creating your own quants)
GGUFi1-IQ1_S7.3for the desperate
GGUFi1-IQ1_M7.8mostly desperate
GGUFi1-IQ2_XXS8.8
GGUFi1-IQ2_XS9.6
GGUFi1-IQ2_S10.3
GGUFi1-IQ2_M11.0
GGUFi1-Q2_K_S11.1very low quality
GGUFi1-Q2_K12.0IQ3_XXS probably better
GGUFi1-IQ3_XXS12.2lower quality
GGUFi1-IQ3_XS13.2
GGUFi1-IQ3_S13.9beats Q3_K*
GGUFi1-Q3_K_S13.9IQ3_XS probably better
GGUFi1-IQ3_M14.5
GGUFi1-Q3_K_M15.4IQ3_S probably better
GGUFi1-Q3_K_L16.7IQ3_M probably better
GGUFi1-IQ4_XS16.8
GGUFi1-Q4_017.8fast, low quality
GGUFi1-Q4_K_S17.9optimal size/speed/quality
GGUFi1-Q4_K_M18.8fast, recommended
GGUFi1-Q4_119.6
GGUFi1-Q5_K_S21.4
GGUFi1-Q5_K_M21.9
GGUFi1-Q6_K25.3practically like static Q6_K

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

Fuentes

1 fuente
Hugging FacePrincipalVersión 06ad9c27686ab2935301d5f7953a638d1a0a49aa
huggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF/tree/06ad9c27686ab2935301d5f7953a638d1a0a49aa

Verificado 3 oct

Artefactos del modelo

24 artefactos

Gemma4-31b-Gembrain-Equinox.i1-IQ1_M.gguf

gguf · 7,20 GB · SHA-256 e4873bc74f1f…e424 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-IQ1_S.gguf

gguf · 6,67 GB · SHA-256 d084b4e5681f…dc7b · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-IQ2_M.gguf

gguf · 10,2 GB · SHA-256 4d3c25dd9073…bdd1 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-IQ2_S.gguf

gguf · 9,46 GB · SHA-256 d2277cb908ff…1450 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-IQ2_XS.gguf

gguf · 8,88 GB · SHA-256 a596f6c74c7d…fca8 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-IQ2_XXS.gguf

gguf · 8,08 GB · SHA-256 33c1fbe4eded…d3d7 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-IQ3_M.gguf

gguf · 13,4 GB · SHA-256 2e5a247aaeac…56b4 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-IQ3_S.gguf

gguf · 12,8 GB · SHA-256 13b995a693ce…fcab · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-IQ3_XS.gguf

gguf · 12,2 GB · SHA-256 afba5ea557bc…cd62 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-IQ3_XXS.gguf

gguf · 11,2 GB · SHA-256 1d0312c75d82…008f · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-IQ4_XS.gguf

gguf · 15,6 GB · SHA-256 780e3237929b…b07e · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q2_K_S.gguf

gguf · 10,2 GB · SHA-256 f2a54bb22323…b528 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q2_K.gguf

gguf · 11,1 GB · SHA-256 d2b7cbb68594…59ca · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q3_K_L.gguf

gguf · 15,5 GB · SHA-256 b19fc0082711…46dd · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q3_K_M.gguf

gguf · 14,2 GB · SHA-256 019d9b618eae…4f5e · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q3_K_S.gguf

gguf · 12,8 GB · SHA-256 cdacc9cd8ab0…e7ac · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q4_0.gguf

gguf · 16,5 GB · SHA-256 9507f582ebfa…769f · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q4_1.gguf

gguf · 18,1 GB · SHA-256 20ac6b6b2927…b0dc · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q4_K_M.gguf

gguf · 17,4 GB · SHA-256 e6dca855e48d…3f83 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q4_K_S.gguf

gguf · 16,5 GB · SHA-256 bba725d4e373…401e · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q5_K_M.gguf

gguf · 20,3 GB · SHA-256 31d7594ece80…9026 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q5_K_S.gguf

gguf · 19,8 GB · SHA-256 1be692e4459a…6e3b · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.i1-Q6_K.gguf

gguf · 23,5 GB · SHA-256 e9c73b3f9e0d…f037 · Hugging Face

Descargar

Gemma4-31b-Gembrain-Equinox.imatrix.gguf

gguf · 13,1 MB · SHA-256 d3444364d027…4dba · Hugging Face

Descargar

Extractos de fuentes

3 extractos
Readme11 julhuggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF

--- base_model: rpDungeon/Gemma4-31b-Gembrain-Equinox language: - en library_name: transformers license: gemma mradermacher: readme_rev: 1 quantized_by: mradermacher tags: - merge - gemma4 - creative-writing - roleplay - fisher-protected --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: nicoboss --> <!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S --> <!-- ### quants_skip: --> <!-- ### skip_mmproj: 1 --> weighted/imatrix quants of https://huggingface.co/rpDungeon/Gemma4-31b-Gembrain-Equinox <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Gemma4-31b-Gembrain-Equinox-i1-GGUF).*** static quants are available at https://huggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-GGUF **This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-GGUF).** ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF/resolve/main/Gemma4-31b-Gembrain-Equinox.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | | [GGUF](https://huggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF/resolve/main/Gemma4-31b-Gembrain-Equinox.i1-IQ1_S.gguf) | i1-IQ1_S | 7.3 | for the desperate | | [GGUF](https://huggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF/resolve/main/Gemma4-31b-Gembrain-Equinox.i1-IQ1_M.gguf) | i1-IQ1_M | 7.8 | mostly desperate | | [GGUF](https://huggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF/resolve/main/Gemma4-31b-Gembrain-Equinox.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 8.8 | | | [GGUF](https://huggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF/resolve/main/Gemma...

Note3 octhuggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF

Source context: 1562 downloads · 0 likes · Library transformers · Repo mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF

Note17 julhuggingface.co/mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF

Source context: 234 downloads · 0 likes · Library transformers · Repo mradermacher/Gemma4-31b-Gembrain-Equinox-i1-GGUF