Aller au contenu
ModelVérifiéExterne
Télécharger

G4 Alice v1.0 31B I1 GGUF

For a convenient overview and download list, visit our model page for this model.

Sourcehuggingface.co/mradermacher/G4-Alice-v1.0-31B-i1-GGUF/tree/e1e016f6655bee339feebb669145a5f855e11b7f
TypeOtherModèle de baseAliceThirty/G4-Alice-v1.0-31BVersionRevision e1e016fÉditeur@mradermacherCClasse

Source du modèle

Type
Other
Taille du fichier
13,1 MB–23,5 GB
Modèle de base
AliceThirty/G4-Alice-v1.0-31B
Version
vRevision e1e016f
Mis à jour
15 sept. 2026
Éditeur
@mradermacher
Téléchargements
364
Paramètres
31B
Source
Hugging Face

Description de la source

About

weighted/imatrix quants of https://huggingface.co/AliceThirty/G4-Alice-v1.0-31B

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/G4-Alice-v1.0-31B-GGUF

This is a vision model - mmproj files (if any) will be in the static repository.

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

LinkTypeSize/GBNotes
GGUFimatrix0.1imatrix file (for creating your own quants)
GGUFi1-IQ1_S7.3for the desperate
GGUFi1-IQ1_M7.8mostly desperate
GGUFi1-IQ2_XXS8.8
GGUFi1-IQ2_XS9.6
GGUFi1-IQ2_S10.3
GGUFi1-IQ2_M11.0
GGUFi1-Q2_K_S11.1very low quality
GGUFi1-Q2_K12.0IQ3_XXS probably better
GGUFi1-IQ3_XXS12.2lower quality
GGUFi1-IQ3_XS13.2
GGUFi1-IQ3_S13.9beats Q3_K*
GGUFi1-Q3_K_S13.9IQ3_XS probably better
GGUFi1-IQ3_M14.5
GGUFi1-Q3_K_M15.4IQ3_S probably better
GGUFi1-Q3_K_L16.7IQ3_M probably better
GGUFi1-IQ4_XS16.8
GGUFi1-Q4_017.8fast, low quality
GGUFi1-Q4_K_S17.9optimal size/speed/quality
GGUFi1-Q4_K_M18.8fast, recommended
GGUFi1-Q4_119.6
GGUFi1-Q5_K_S21.4
GGUFi1-Q5_K_M21.9
GGUFi1-Q6_K25.3practically like static Q6_K

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

Sources

1 source
Hugging FacePrincipalVersion e1e016f6655bee339feebb669145a5f855e11b7f
huggingface.co/mradermacher/G4-Alice-v1.0-31B-i1-GGUF/tree/e1e016f6655bee339feebb669145a5f855e11b7f

Vérifié 10 août

Artefacts du modèle

24 artefacts

G4-Alice-v1.0-31B.i1-IQ1_M.gguf

gguf · 7,20 GB · SHA-256 3d379fff8ba5…d3ad · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-IQ1_S.gguf

gguf · 6,67 GB · SHA-256 57bd8d234d1b…1bf1 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-IQ2_M.gguf

gguf · 10,2 GB · SHA-256 4360ed7be6b7…08f7 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-IQ2_S.gguf

gguf · 9,46 GB · SHA-256 315998c3f6e8…be56 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-IQ2_XS.gguf

gguf · 8,88 GB · SHA-256 c1033894ce20…2093 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-IQ2_XXS.gguf

gguf · 8,08 GB · SHA-256 443fda6d869b…c492 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-IQ3_M.gguf

gguf · 13,4 GB · SHA-256 ac41fe9261b8…1740 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-IQ3_S.gguf

gguf · 12,8 GB · SHA-256 bba6394dca82…6209 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-IQ3_XS.gguf

gguf · 12,2 GB · SHA-256 9ea3da8914b0…d0c2 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-IQ3_XXS.gguf

gguf · 11,2 GB · SHA-256 9128ee05f739…3c66 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-IQ4_XS.gguf

gguf · 15,6 GB · SHA-256 e0c7cb5f3d70…e653 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q2_K_S.gguf

gguf · 10,2 GB · SHA-256 72e2061478f5…277c · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q2_K.gguf

gguf · 11,1 GB · SHA-256 6acc335342cf…8960 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q3_K_L.gguf

gguf · 15,5 GB · SHA-256 fcf94c87df6b…6fd8 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q3_K_M.gguf

gguf · 14,2 GB · SHA-256 92910e04f728…ab15 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q3_K_S.gguf

gguf · 12,8 GB · SHA-256 f50173000d72…56df · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q4_0.gguf

gguf · 16,5 GB · SHA-256 b656a073da4c…37f1 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q4_1.gguf

gguf · 18,1 GB · SHA-256 700136b1d3fe…18e7 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q4_K_M.gguf

gguf · 17,4 GB · SHA-256 1f7a36146573…122e · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q4_K_S.gguf

gguf · 16,5 GB · SHA-256 10155d1aafc4…83f3 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q5_K_M.gguf

gguf · 20,3 GB · SHA-256 4fd2254e8c3d…49b0 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q5_K_S.gguf

gguf · 19,8 GB · SHA-256 f96f08c638fc…0585 · Hugging Face

Télécharger

G4-Alice-v1.0-31B.i1-Q6_K.gguf

gguf · 23,5 GB · SHA-256 5a06b259ee39…ce8c · Hugging Face

Télécharger

G4-Alice-v1.0-31B.imatrix.gguf

gguf · 13,1 MB · SHA-256 95f28cfa8340…75cb · Hugging Face

Télécharger

Extraits de sources

3 extraits
Readme11 juil.huggingface.co/mradermacher/G4-Alice-v1.0-31B-i1-GGUF

--- base_model: AliceThirty/G4-Alice-v1.0-31B datasets: - zerofata/Instruct-Anime - zerofata/Gemini-3.1-Pro-GLM5-Characters - zerofata/Gemini-3.1-Pro-SmallWiki language: - en library_name: transformers license: apache-2.0 mradermacher: readme_rev: 1 quantized_by: mradermacher --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: nicoboss --> <!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S --> <!-- ### quants_skip: --> <!-- ### skip_mmproj: --> weighted/imatrix quants of https://huggingface.co/AliceThirty/G4-Alice-v1.0-31B <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#G4-Alice-v1.0-31B-i1-GGUF).*** static quants are available at https://huggingface.co/mradermacher/G4-Alice-v1.0-31B-GGUF **This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/G4-Alice-v1.0-31B-GGUF).** ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/G4-Alice-v1.0-31B-i1-GGUF/resolve/main/G4-Alice-v1.0-31B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | | [GGUF](https://huggingface.co/mradermacher/G4-Alice-v1.0-31B-i1-GGUF/resolve/main/G4-Alice-v1.0-31B.i1-IQ1_S.gguf) | i1-IQ1_S | 7.3 | for the desperate | | [GGUF](https://huggingface.co/mradermacher/G4-Alice-v1.0-31B-i1-GGUF/resolve/main/G4-Alice-v1.0-31B.i1-IQ1_M.gguf) | i1-IQ1_M | 7.8 | mostly desperate | | [GGUF](https://huggingface.co/mradermacher/G4-Alice-v1.0-31B-i1-GGUF/resolve/main/G4-Alice-v1.0-31B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 8.8 | | | [GGUF](https://huggingface.co/mradermacher/G4-Alice-v1.0-31B-i1-GGUF/resolve/main/G4-Alice-v1.0-31B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 9.6 | | | [GGUF](https://huggingface.co/mraderma...

Note10 aoûthuggingface.co/mradermacher/G4-Alice-v1.0-31B-i1-GGUF

Source context: 364 downloads · 1 likes · Library transformers · Repo mradermacher/G4-Alice-v1.0-31B-i1-GGUF

Note17 juil.huggingface.co/mradermacher/G4-Alice-v1.0-31B-i1-GGUF

Source context: 5823 downloads · 1 likes · Library transformers · Repo mradermacher/G4-Alice-v1.0-31B-i1-GGUF