ModelVérifiéExterne

Aitana 7B S Instruct GGUF

For a convenient overview and download list, visit our model page for this model.

Sourcehuggingface.co/mradermacher/Aitana-7B-S-Instruct-GGUF/tree/4a99ddb82bf3e8bb9d7877b9b69377d5c1363d66

TypeOtherModèle de basegplsi/Aitana-7B-S-InstructVersionRevision 4a99ddbÉditeur@mradermacherCClasse

Source du modèle

Type: Other
Taille du fichier: 3,08–14,5 GB
Modèle de base: gplsi/Aitana-7B-S-Instruct
Version: vRevision 4a99ddb
Mis à jour: 3 oct. 2026
Éditeur: @mradermacher
Téléchargements: 919
Paramètres: 7B
Tâches: Génération de texte
Source: Hugging Face

Description de la source

About

static quants of https://huggingface.co/gplsi/Aitana-7B-S-Instruct

For a convenient overview and download list, visit our model page for this model.

weighted/imatrix quants are available at https://huggingface.co/mradermacher/Aitana-7B-S-Instruct-i1-GGUF

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Link	Type	Size/GB	Notes
GGUF	Q2_K	3.4
GGUF	Q3_K_S	3.9
GGUF	Q3_K_M	4.1	lower quality
GGUF	Q3_K_L	4.4
GGUF	IQ4_XS	4.6
GGUF	Q4_K_S	4.8	fast, recommended
GGUF	Q4_K_M	5.0	fast, recommended
GGUF	Q5_K_S	5.6
GGUF	Q5_K_M	5.7
GGUF	Q6_K	6.5	very good quality
GGUF	Q8_0	8.4	fast, best quality
GGUF	f16	15.6	16 bpw, overkill

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time.

Sources

1 source

Hugging FacePrincipalVersion 4a99ddb82bf3e8bb9d7877b9b69377d5c1363d66

huggingface.co/mradermacher/Aitana-7B-S-Instruct-GGUF/tree/4a99ddb82bf3e8bb9d7877b9b69377d5c1363d66

Vérifié 3 oct.

Artefacts du modèle

12 artefacts

Aitana-7B-S-Instruct.f16.gguf

gguf · 14,5 GB · SHA-256 65051d38633e…4904 · Hugging Face

Télécharger

Aitana-7B-S-Instruct.IQ4_XS.gguf

gguf · 4,18 GB · SHA-256 567e2cc071fd…3191 · Hugging Face

Télécharger

Aitana-7B-S-Instruct.Q2_K.gguf

gguf · 3,08 GB · SHA-256 7ed4f1748fbc…7c6e · Hugging Face

Télécharger

Aitana-7B-S-Instruct.Q3_K_L.gguf

gguf · 4,00 GB · SHA-256 771b41e108f0…2a11 · Hugging Face

Télécharger

Aitana-7B-S-Instruct.Q3_K_M.gguf

gguf · 3,77 GB · SHA-256 c55faa2f5502…2b27 · Hugging Face

Télécharger

Aitana-7B-S-Instruct.Q3_K_S.gguf

gguf · 3,50 GB · SHA-256 1ef0518c6a03…8d0c · Hugging Face

Télécharger

Aitana-7B-S-Instruct.Q4_K_M.gguf

gguf · 4,52 GB · SHA-256 33e5a7a4ba82…8d42 · Hugging Face

Télécharger

Aitana-7B-S-Instruct.Q4_K_S.gguf

gguf · 4,35 GB · SHA-256 1f47f42c7a51…1814 · Hugging Face

Télécharger

Aitana-7B-S-Instruct.Q5_K_M.gguf

gguf · 5,21 GB · SHA-256 89093e78763d…6923 · Hugging Face

Télécharger

Aitana-7B-S-Instruct.Q5_K_S.gguf

gguf · 5,11 GB · SHA-256 576f0b715a85…6f1b · Hugging Face

Télécharger

Aitana-7B-S-Instruct.Q6_K.gguf

gguf · 5,94 GB · SHA-256 d18a07e8334c…0e6a · Hugging Face

Télécharger

Aitana-7B-S-Instruct.Q8_0.gguf

gguf · 7,69 GB · SHA-256 7206a42b51b6…ae8b · Hugging Face

Télécharger

Extraits de sources

3 extraits

Readme11 juil.huggingface.co/mradermacher/Aitana-7B-S-Instruct-GGUF

--- base_model: gplsi/Aitana-7B-S-Instruct datasets: - OpenAssistant/oasst2 - OpenAssistant/oasst1 - BSC-LT/m-personas - projecte-aina/RAG_Multilingual - facebook/flores - CohereLabs/aya_dataset - Unbabel/TowerBlocks-v0.2 - projecte-aina/MentorES - databricks/databricks-dolly-15k - tatsu-lab/alpaca - openai/gsm8k - Open-Orca/OpenOrca - HuggingFaceH4/no_robots - projecte-aina/CoQCat - gplsi/boua_parallel - allenai/scifact - somosnlp/LingComp_QA - somosnlp/instruct-legal-refugiados-es language: - ca - es - en library_name: transformers license: apache-2.0 mradermacher: readme_rev: 1 quantized_by: mradermacher tags: - valencian - spanish - english - text-generation - instruct - alia - gplsi --- ## About         static quants of https://huggingface.co/gplsi/Aitana-7B-S-Instruct  ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Aitana-7B-S-Instruct-GGUF).*** weighted/imatrix quants are available at https://huggingface.co/mradermacher/Aitana-7B-S-Instruct-i1-GGUF ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/Aitana-7B-S-Instruct-GGUF/resolve/main/Aitana-7B-S-Instruct.Q2_K.gguf) | Q2_K | 3.4 | | | [GGUF](https://huggingface.co/mradermacher/Aitana-7B-S-Instruct-GGUF/resolve/main/Aitana-7B-S-Instruct.Q3_K_S.gguf) | Q3_K_S | 3.9 | | | [GGUF](https://huggingface.co/mradermacher/Aitana-7B-S-Instruct-GGUF/resolve/main/Aitana-7B-S-Instruct.Q3_K_M.gguf) | Q3_K_M | 4.1 | lower quality | | [GGUF](https://huggingface.co/mradermacher/Aitana-7B-S-Instruct-GGUF/resolve/main/Aitana-7B-S-Instruct.Q3_K_L.gguf) | Q3_K_L | 4.4 | | | [GGUF](https://huggingface.co/mradermacher/Aitana-7B-S-Instruct-GGUF/res...

Note3 oct.huggingface.co/mradermacher/Aitana-7B-S-Instruct-GGUF

Source context: 919 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo mradermacher/Aitana-7B-S-Instruct-GGUF

Note17 juil.huggingface.co/mradermacher/Aitana-7B-S-Instruct-GGUF

Source context: 112 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo mradermacher/Aitana-7B-S-Instruct-GGUF