Aller au contenu
ModelVérifiéExterne
Télécharger

ToolSpace Full SFT Qwen3 8B I1 GGUF

For a convenient overview and download list, visit our model page for this model.

Sourcehuggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF/tree/3a5aa02c5e45927dd8f555d138dedd8e206142ed
TypeOtherModèle de basehahayhe/ToolSpace-Full-SFT-Qwen3-8BVersionRevision 3a5aa02Éditeur@mradermacherCClasse

Source du modèle

Type
Other
Taille du fichier
5,10 MB–6,26 GB
Modèle de base
hahayhe/ToolSpace-Full-SFT-Qwen3-8B
Version
vRevision 3a5aa02
Mis à jour
4 oct. 2026
Éditeur
@mradermacher
Téléchargements
892
Paramètres
8B
Source
Hugging Face

Description de la source

About

weighted/imatrix quants of https://huggingface.co/hahayhe/ToolSpace-Full-SFT-Qwen3-8B

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-GGUF

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

LinkTypeSize/GBNotes
GGUFimatrix0.1imatrix file (for creating your own quants)
GGUFi1-IQ1_S2.2for the desperate
GGUFi1-IQ1_M2.4mostly desperate
GGUFi1-IQ2_XXS2.6
GGUFi1-IQ2_XS2.8
GGUFi1-IQ2_S3.0
GGUFi1-IQ2_M3.2
GGUFi1-Q2_K_S3.2very low quality
GGUFi1-Q2_K3.4IQ3_XXS probably better
GGUFi1-IQ3_XXS3.5lower quality
GGUFi1-IQ3_XS3.7
GGUFi1-Q3_K_S3.9IQ3_XS probably better
GGUFi1-IQ3_S3.9beats Q3_K*
GGUFi1-IQ3_M4.0
GGUFi1-Q3_K_M4.2IQ3_S probably better
GGUFi1-Q3_K_L4.5IQ3_M probably better
GGUFi1-IQ4_XS4.7
GGUFi1-Q4_04.9fast, low quality
GGUFi1-IQ4_NL4.9prefer IQ4_XS
GGUFi1-Q4_K_S4.9optimal size/speed/quality
GGUFi1-Q4_K_M5.1fast, recommended
GGUFi1-Q4_15.3
GGUFi1-Q5_K_S5.8
GGUFi1-Q5_K_M6.0
GGUFi1-Q6_K6.8practically like static Q6_K

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

Sources

1 source
Hugging FacePrincipalVersion 3a5aa02c5e45927dd8f555d138dedd8e206142ed
huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF/tree/3a5aa02c5e45927dd8f555d138dedd8e206142ed

Vérifié 4 oct.

Artefacts du modèle

25 artefacts

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ1_M.gguf

gguf · 2,10 GB · SHA-256 cdbf8c2b5110…b0d2 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ1_S.gguf

gguf · 1,97 GB · SHA-256 c98ee561794c…abbb · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ2_M.gguf

gguf · 2,84 GB · SHA-256 997509a55ec5…238e · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ2_S.gguf

gguf · 2,67 GB · SHA-256 e914359828de…7760 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ2_XS.gguf

gguf · 2,51 GB · SHA-256 5e10cef35ca8…fff5 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ2_XXS.gguf

gguf · 2,32 GB · SHA-256 ceb8bc5ee139…ae6d · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ3_M.gguf

gguf · 3,63 GB · SHA-256 c0f460882b94…3d95 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ3_S.gguf

gguf · 3,53 GB · SHA-256 1bedfac745c1…feb9 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ3_XS.gguf

gguf · 3,38 GB · SHA-256 6180ff7ba568…2f69 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ3_XXS.gguf

gguf · 3,14 GB · SHA-256 59ab4b08df13…a1ca · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ4_NL.gguf

gguf · 4,46 GB · SHA-256 365e6616ef08…2c45 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-IQ4_XS.gguf

gguf · 4,25 GB · SHA-256 8ab9bbe21bd7…9bd4 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q2_K_S.gguf

gguf · 2,87 GB · SHA-256 884dfe442df4…415b · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q2_K.gguf

gguf · 3,06 GB · SHA-256 7c304b40f4a9…01e0 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q3_K_L.gguf

gguf · 4,13 GB · SHA-256 4f460f2948b8…953c · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q3_K_M.gguf

gguf · 3,84 GB · SHA-256 9a7bfe33250b…3536 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q3_K_S.gguf

gguf · 3,51 GB · SHA-256 6120b18ef9f8…84f8 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q4_0.gguf

gguf · 4,46 GB · SHA-256 cc7d4d8bf780…bb26 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q4_1.gguf

gguf · 4,89 GB · SHA-256 fc419f891f89…d240 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q4_K_M.gguf

gguf · 4,68 GB · SHA-256 d93c78da505f…a82b · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q4_K_S.gguf

gguf · 4,47 GB · SHA-256 92d98dbe9c7b…55e6 · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q5_K_M.gguf

gguf · 5,45 GB · SHA-256 020ac6f6e9e8…c4ff · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q5_K_S.gguf

gguf · 5,33 GB · SHA-256 187e9eb1f7e4…e43f · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.i1-Q6_K.gguf

gguf · 6,26 GB · SHA-256 89e6708f36a7…56db · Hugging Face

Télécharger

ToolSpace-Full-SFT-Qwen3-8B.imatrix.gguf

gguf · 5,10 MB · SHA-256 703f062f6db5…c54c · Hugging Face

Télécharger

Extraits de sources

3 extraits
Readme11 juil.huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF

--- base_model: hahayhe/ToolSpace-Full-SFT-Qwen3-8B language: - en library_name: transformers license: other mradermacher: readme_rev: 1 quantized_by: mradermacher tags: - llama-factory - full - generated_from_trainer --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: nicoboss --> <!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S --> <!-- ### quants_skip: --> <!-- ### skip_mmproj: --> weighted/imatrix quants of https://huggingface.co/hahayhe/ToolSpace-Full-SFT-Qwen3-8B <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF).*** static quants are available at https://huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-GGUF ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF/resolve/main/ToolSpace-Full-SFT-Qwen3-8B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | | [GGUF](https://huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF/resolve/main/ToolSpace-Full-SFT-Qwen3-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate | | [GGUF](https://huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF/resolve/main/ToolSpace-Full-SFT-Qwen3-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate | | [GGUF](https://huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF/resolve/main/ToolSpace-Full-SFT-Qwen3-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | | | [GGUF](https://huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF/resolve/main/ToolSpace-Full-SFT-Qwen3-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | | | [GGUF](https://huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF/resolve/main/ToolSpace-Full-SFT-Qwen3-8B...

Note4 oct.huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF

Source context: 892 downloads · 1 likes · Library transformers · Repo mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF

Note17 juil.huggingface.co/mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF

Source context: 3535 downloads · 0 likes · Library transformers · Repo mradermacher/ToolSpace-Full-SFT-Qwen3-8B-i1-GGUF