Loading
Vous avez un workflow ComfyUI ? Obtenez une documentation lisible directement dans votre navigateur.Rendre un workflow lisible.Essayer maintenant ↗
For a convenient overview and download list, visit our model page for this model.
Source du modèle
Description de la source
weighted/imatrix quants of https://huggingface.co/prithivMLmods/Qwen2.5-VL-3B-Abliterated-Caption-it
For a convenient overview and download list, visit our model page for this model.
static quants are available at
Sources
1 sourceVérifié 17 sept.
Artefacts du modèle
25 artefactsQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ1_M.gguf
gguf · 811 MB · SHA-256 fa656db0d592…6390 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ1_S.gguf
gguf · 754 MB · SHA-256 d345e1af2a8e…f456 · Hugging Face
TéléchargerExtraits de sources
2 extraitsThis is a vision model - mmproj files (if any) will be in the static repository.
If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | imatrix | 0.1 | imatrix file (for creating your own quants) |
| GGUF | i1-IQ1_S | 0.9 | for the desperate |
| GGUF | i1-IQ1_M | 1.0 | mostly desperate |
| GGUF | i1-IQ2_XXS | 1.0 |
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
image.png
And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.
I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ2_M.gguf
gguf · 1,06 GB · SHA-256 659480d1f4c0…d385 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ2_S.gguf
gguf · 1 013 MB · SHA-256 15b21aa5d9fc…a9c4 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ2_XS.gguf
gguf · 984 MB · SHA-256 e274d7611fe3…f9b1 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ2_XXS.gguf
gguf · 904 MB · SHA-256 b7710317d0ca…b384 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ3_M.gguf
gguf · 1,39 GB · SHA-256 c559c326822b…f63c · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ3_S.gguf
gguf · 1,36 GB · SHA-256 0acd1e332994…a3be · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ3_XS.gguf
gguf · 1,30 GB · SHA-256 da25394b0bf0…d7a7 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ3_XXS.gguf
gguf · 1,19 GB · SHA-256 a097bc4172ab…e89c · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ4_NL.gguf
gguf · 1,70 GB · SHA-256 7c347375a9b8…4545 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ4_XS.gguf
gguf · 1,62 GB · SHA-256 1e2134098c10…43c3 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q2_K_S.gguf
gguf · 1,12 GB · SHA-256 595835c626c0…bdf2 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q2_K.gguf
gguf · 1,19 GB · SHA-256 38851e85ce73…5255 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q3_K_L.gguf
gguf · 1,59 GB · SHA-256 b4b1cfcc7010…6e5f · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q3_K_M.gguf
gguf · 1,48 GB · SHA-256 c9590090347a…4c9c · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q3_K_S.gguf
gguf · 1,35 GB · SHA-256 919f044a45c9…99a0 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q4_0.gguf
gguf · 1,70 GB · SHA-256 c7df5b6cad8a…207f · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q4_1.gguf
gguf · 1,86 GB · SHA-256 6330c7bbf88d…d00d · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q4_K_M.gguf
gguf · 1,80 GB · SHA-256 d5215695cb99…a224 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q4_K_S.gguf
gguf · 1,71 GB · SHA-256 30e1f2737acb…aa80 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q5_K_M.gguf
gguf · 2,07 GB · SHA-256 f5db8c3cf37d…93be · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q5_K_S.gguf
gguf · 2,02 GB · SHA-256 40e998462c51…9407 · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.i1-Q6_K.gguf
gguf · 2,36 GB · SHA-256 0164723bf87c…2bcd · Hugging Face
TéléchargerQwen2.5-VL-3B-Abliterated-Caption-it.imatrix.gguf
gguf · 3,24 MB · SHA-256 5827466658fd…1fcd · Hugging Face
Télécharger--- base_model: prithivMLmods/Qwen2.5-VL-3B-Abliterated-Caption-it language: - en library_name: transformers mradermacher: readme_rev: 1 quantized_by: mradermacher tags: - text-generation-inference - uncensored - image-captioning - vlm - visual-understanding - caption - image-to-text --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: nicoboss --> <!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S --> <!-- ### quants_skip: --> <!-- ### skip_mmproj: --> weighted/imatrix quants of https://huggingface.co/prithivMLmods/Qwen2.5-VL-3B-Abliterated-Caption-it <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF).*** static quants are available at https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-GGUF **This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-GGUF).** ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-3B-Abliterated-Caption-it.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate | | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate | | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-3B-Ablit...
Source context: 1086 downloads · 4 likes · Pipeline image-to-text · Library transformers · Repo mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF
| GGUF | i1-IQ2_XS | 1.1 |
| GGUF | i1-IQ2_S | 1.2 |
| GGUF | i1-IQ2_M | 1.2 |
| GGUF | i1-Q2_K_S | 1.3 | very low quality |
| GGUF | i1-Q2_K | 1.4 | IQ3_XXS probably better |
| GGUF | i1-IQ3_XXS | 1.4 | lower quality |
| GGUF | i1-IQ3_XS | 1.5 |
| GGUF | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
| GGUF | i1-IQ3_S | 1.6 | beats Q3_K* |
| GGUF | i1-IQ3_M | 1.6 |
| GGUF | i1-Q3_K_M | 1.7 | IQ3_S probably better |
| GGUF | i1-Q3_K_L | 1.8 | IQ3_M probably better |
| GGUF | i1-IQ4_XS | 1.8 |
| GGUF | i1-IQ4_NL | 1.9 | prefer IQ4_XS |
| GGUF | i1-Q4_0 | 1.9 | fast, low quality |
| GGUF | i1-Q4_K_S | 1.9 | optimal size/speed/quality |
| GGUF | i1-Q4_K_M | 2.0 | fast, recommended |
| GGUF | i1-Q4_1 | 2.1 |
| GGUF | i1-Q5_K_S | 2.3 |
| GGUF | i1-Q5_K_M | 2.3 |
| GGUF | i1-Q6_K | 2.6 | practically like static Q6_K |
