Zum Inhalt springen
ModelAufgelistetExtern
Browse files

Qwen2.5 VL 7B Abliterated Caption It I1 GGUF

For a convenient overview and download list, visit our model page for this model.

Quellehuggingface.co/fairy322/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF/tree/31114d59fb95b2ad9a86ddbf80554c17deb3f0a7
ArtModellBasismodellprithivMLmods/Qwen2.5-VL-7B-Abliterated-Caption-itVersionRevision 31114d5BBewertung

Modellquelle

Art
Modell
Dateigröße
4,35 MB–5,82 GB
Basismodell
prithivMLmods/Qwen2.5-VL-7B-Abliterated-Caption-it
Version
vRevision 31114d5
Aktualisiert
30. Okt. 2026
Downloads
408
Quelle
Hugging Face

Quellenbeschreibung

About

weighted/imatrix quants of https://huggingface.co/prithivMLmods/Qwen2.5-VL-7B-Abliterated-Caption-it

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/Qwen2.5-VL-7B-Abliterated-Caption-it-GGUF

This is a vision model - mmproj files (if any) will be in the static repository.

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

LinkTypeSize/GBNotes
GGUFimatrix0.1imatrix file (for creating your own quants)
GGUFi1-IQ1_S2.0for the desperate
GGUFi1-IQ1_M2.1mostly desperate
GGUFi1-IQ2_XXS2.4
GGUFi1-IQ2_XS2.6
GGUFi1-IQ2_S2.7
GGUFi1-IQ2_M2.9
GGUFi1-Q2_K_S2.9very low quality
GGUFi1-Q2_K3.1IQ3_XXS probably better
GGUFi1-IQ3_XXS3.2lower quality
GGUFi1-IQ3_XS3.4
GGUFi1-Q3_K_S3.6IQ3_XS probably better
GGUFi1-IQ3_S3.6beats Q3_K*
GGUFi1-IQ3_M3.7
GGUFi1-Q3_K_M3.9IQ3_S probably better
GGUFi1-Q3_K_L4.2IQ3_M probably better
GGUFi1-IQ4_XS4.3
GGUFi1-IQ4_NL4.5prefer IQ4_XS
GGUFi1-Q4_04.5fast, low quality
GGUFi1-Q4_K_S4.6optimal size/speed/quality
GGUFi1-Q4_K_M4.8fast, recommended
GGUFi1-Q4_15.0
GGUFi1-Q5_K_S5.4
GGUFi1-Q5_K_M5.5
GGUFi1-Q6_K6.4practically like static Q6_K

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

Quellen

1 Quelle
Hugging FacePrimärVersion 31114d59fb95b2ad9a86ddbf80554c17deb3f0a7
huggingface.co/fairy322/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF/tree/31114d59fb95b2ad9a86ddbf80554c17deb3f0a7

Verifiziert 30. Okt.

Download files

Modellartefakte

25 Artefakte

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ1_M.gguf

gguf · 1,90 GB · SHA-256 b061f911f8dd…a098 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ1_S.gguf

gguf · 1,77 GB · SHA-256 cc7bc994b121…82c2 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ2_M.gguf

gguf · 2,59 GB · SHA-256 c8b814695001…c2e0 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ2_S.gguf

gguf · 2,42 GB · SHA-256 24cfa59ae810…49db · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ2_XS.gguf

gguf · 2,30 GB · SHA-256 cd2a68b59c94…840a · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ2_XXS.gguf

gguf · 2,12 GB · SHA-256 961d80d52b4b…529c · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ3_M.gguf

gguf · 3,33 GB · SHA-256 162b8bde9149…b9f6 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ3_S.gguf

gguf · 3,26 GB · SHA-256 7020374dff14…e339 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ3_XS.gguf

gguf · 3,12 GB · SHA-256 32bdd05a421d…6660 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ3_XXS.gguf

gguf · 2,90 GB · SHA-256 b0121602fc7e…a47f · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ4_NL.gguf

gguf · 4,13 GB · SHA-256 c621e5bd0e86…f102 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ4_XS.gguf

gguf · 3,93 GB · SHA-256 28c916be62e6…c231 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q2_K_S.gguf

gguf · 2,64 GB · SHA-256 7141fca12519…e6cd · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q2_K.gguf

gguf · 2,81 GB · SHA-256 bc1152811f01…94ab · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q3_K_L.gguf

gguf · 3,81 GB · SHA-256 ef0bcdfc6faf…4952 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q3_K_M.gguf

gguf · 3,55 GB · SHA-256 1baa01090cf1…af80 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q3_K_S.gguf

gguf · 3,25 GB · SHA-256 f7417f9f986e…2a21 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q4_0.gguf

gguf · 4,14 GB · SHA-256 e7b793fe1452…1c04 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q4_1.gguf

gguf · 4,54 GB · SHA-256 ad3c14f8f09d…df73 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q4_K_M.gguf

gguf · 4,36 GB · SHA-256 3b823955e838…58c2 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q4_K_S.gguf

gguf · 4,15 GB · SHA-256 6efe3e21ea56…ad93 · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q5_K_M.gguf

gguf · 5,07 GB · SHA-256 9b05b9f08f39…e37e · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q5_K_S.gguf

gguf · 4,95 GB · SHA-256 25b49445d25a…760a · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.i1-Q6_K.gguf

gguf · 5,82 GB · SHA-256 95d8e55df55c…3cba · Hugging Face

Download file

Qwen2.5-VL-7B-Abliterated-Caption-it.imatrix.gguf

gguf · 4,35 MB · SHA-256 69642d2a9c4a…ed08 · Hugging Face

Download file

Quellenauszüge

3 Auszüge
Readme14. Aug.huggingface.co/fairy322/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF

--- base_model: prithivMLmods/Qwen2.5-VL-7B-Abliterated-Caption-it datasets: - prithivMLmods/blip3o-caption-mini-arrow - prithivMLmods/Caption3o-Opt-v2 language: - en - zh - th library_name: transformers license: apache-2.0 mradermacher: readme_rev: 1 quantized_by: mradermacher tags: - text-generation-inference - uncensored - image-captioning - vlm - visual-understanding - caption - image-to-text --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: nicoboss --> weighted/imatrix quants of https://huggingface.co/prithivMLmods/Qwen2.5-VL-7B-Abliterated-Caption-it <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF).*** static quants are available at https://huggingface.co/mradermacher/Qwen2.5-VL-7B-Abliterated-Caption-it-GGUF **This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Qwen2.5-VL-7B-Abliterated-Caption-it-GGUF).** ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-7B-Abliterated-Caption-it.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ1_S.gguf) | i1-IQ1_S | 2.0 | for the desperate | | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ1_M.gguf) | i1-IQ1_M | 2.1 | mostly desperate | | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-7B-Abliterated-Caption-it.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.4 | | | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-7B-Abl...

Note30. Okt.huggingface.co/fairy322/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF

Source context: 408 downloads · 1 likes · Pipeline image-to-text · Library transformers · Repo fairy322/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF

Note14. Aug.huggingface.co/fairy322/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF

Source context: 348 downloads · 1 likes · Pipeline image-to-text · Library transformers · Repo fairy322/Qwen2.5-VL-7B-Abliterated-Caption-it-i1-GGUF