ModelPrésentéExterne

Qwen3 VL 8B Instruct Unredacted MAX Quants GGUF

This repository contains high-quality GGUF quantizations for the prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX model.

Sourcehuggingface.co/KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF/tree/d2db200bba5cc65c50959a5d5624e34d6cc8e7bc

TypeOtherModèle de baseprithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAXVersionRevision d2db200BClasse

Source du modèle

Type: Other
Taille du fichier: 717 MB–15,3 GB
Modèle de base: prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX
Version: vRevision d2db200
Mis à jour: 11 oct. 2026
Téléchargements: 1,2 k
Source: Hugging Face

Description de la source

Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF

This repository contains high-quality GGUF quantizations for the prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX model.

Highlights

Unredacted & MAX: Maximum performance version without restrictive filters.
Full Vision Support: Includes multiple versions of the vision projector (mmproj) for different hardware needs.
Optimized: Compatible with the latest llama.cpp and other GGUF-supported backends.

Files Included

1. Model Weights (LLM)

Filename	Quant Method	Description
`Q4_K_M.gguf`	Q4_K_M	Recommended. Best balance of speed and intelligence.
`Q8_0.gguf`	Q8_0	High quality, nearly identical to original weights.
`Q6_K.gguf`	Q6_K	Very high quality, slightly slower than Q4.
`Q5_K_M.gguf`	Q5_K_M	Good balance between Q4 and Q6.
`Q3_K_M.gguf`	Q3_K_M	Low size, moderate quality loss.
`Q2_K.gguf`	Q2_K	Smallest possible size, significant quality loss.
`F16.gguf`	F16	Baseline reference quality.

2. Vision Projectors (mmproj)

Required for image recognition tasks.

Filename	Type	Description
`mmproj-f32.gguf`	F32	Absolute maximum precision (2.3GB).
`mmproj-f16.gguf`	F16	Industry standard for high-quality vision.
`mmproj-bf16.gguf`	BF16	Optimized for modern NVIDIA GPUs (Ampere+).
`mmproj-q8_0.gguf`	Q8_0	Best for saving VRAM without losing recognition detail.

Usage

To use vision capabilities in llama.cpp, use the following command:

./llama-cli -m Qwen3-VL-8B-Instruct-Unredacted-MAX.Q4_K_M.gguf \
            --mmproj Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-f16.gguf \
            --image path/to/your/image.jpg \
            -p "Describe this image"

Sources

1 source

Hugging FacePrincipalVersion d2db200bba5cc65c50959a5d5624e34d6cc8e7bc

huggingface.co/KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF/tree/d2db200bba5cc65c50959a5d5624e34d6cc8e7bc

Vérifié 27 août

Artefacts du modèle

14 artefacts

Qwen3-VL-8B-Instruct-Unredacted-MAX.F16.gguf

gguf · 15,3 GB · SHA-256 5f01c6e4fa7c…f11a · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-bf16.gguf

gguf · 1,08 GB · SHA-256 cfeeb05fd175…01bd · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-f16.gguf

gguf · 1,08 GB · SHA-256 c3ebc2452746…6f4d · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-f32.gguf

gguf · 2,15 GB · SHA-256 52f312496b8e…9a42 · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-q8_0.gguf

gguf · 717 MB · SHA-256 89569d776537…d090 · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q2_K.gguf

gguf · 3,06 GB · SHA-256 7dc185c46446…7327 · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q3_K_L.gguf

gguf · 4,13 GB · SHA-256 f1ff47b24713…74eb · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q3_K_M.gguf

gguf · 3,84 GB · SHA-256 7d9c61e33527…5862 · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q4_K_M.gguf

gguf · 4,68 GB · SHA-256 79b2d3dd474e…600b · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q4_K_S.gguf

gguf · 4,47 GB · SHA-256 c74ab4d05b7f…0439 · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q5_K_M.gguf

gguf · 5,45 GB · SHA-256 b4f06532b484…585f · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q5_K_S.gguf

gguf · 5,33 GB · SHA-256 755b91a88ad4…317c · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q6_K.gguf

gguf · 6,26 GB · SHA-256 67aed8a6ac85…7a2e · Hugging Face

Télécharger

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q8_0.gguf

gguf · 8,11 GB · SHA-256 f01e2918d966…9687 · Hugging Face

Télécharger

Extraits de sources

2 extraits

Readme27 aoûthuggingface.co/KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF

--- license: apache-2.0 language: - en - ru - zh tags: - vision - multimodal - gguf - qwen - qwen-3 - unredacted - image-to-text - text-generation - conversational - roleplay - assistant - vl - vlm pipeline_tag: image-to-text library_name: gguf base_model: - prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX --- ![1](https://camo.githubusercontent.com/17b4379eedbf639f0fc005e6512f2a629b9cb059d3cc4eacc1ec65fa21f92898/68747470733a2f2f7169616e77656e2d7265732e6f73732d616363656c65726174652e616c6979756e63732e636f6d2f5177656e332d564c2f7177656e33766c6c6f676f2e706e67) # Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF This repository contains high-quality GGUF quantizations for the [prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX](https://huggingface.co/prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX) model. ## Highlights - **Unredacted & MAX**: Maximum performance version without restrictive filters. - **Full Vision Support**: Includes multiple versions of the vision projector (`mmproj`) for different hardware needs. - **Optimized**: Compatible with the latest `llama.cpp` and other GGUF-supported backends. ## Files Included ### 1. Model Weights (LLM) | Filename | Quant Method | Description | | :--- | :--- | :--- | | `Q4_K_M.gguf` | Q4_K_M | **Recommended.** Best balance of speed and intelligence. | | `Q8_0.gguf` | Q8_0 | High quality, nearly identical to original weights. | | `Q6_K.gguf` | Q6_K | Very high quality, slightly slower than Q4. | | `Q5_K_M.gguf` | Q5_K_M | Good balance between Q4 and Q6. | | `Q3_K_M.gguf` | Q3_K_M | Low size, moderate quality loss. | | `Q2_K.gguf` | Q2_K | Smallest possible size, significant quality loss. | | `F16.gguf` | F16 | Baseline reference quality. | ### 2. Vision Projectors (mmproj) *Required for image recognition tasks.* | Filename | Type | Description | | :--- | :--- | :--- | | `mmproj-f32.gguf` | F32 | Absolute maximum precision (2.3GB). | | `mmproj-f16.gguf` | F16 | Industry standard for high-quality vision. | | `mmproj-bf16.gguf` | BF16 | Optimized for modern NVIDIA GPUs (Ampere+). | | `mmproj-q8_0.gguf` | Q8_0 | Best for saving VRAM without losing recognition detail. | ## Usage To use vision capabilities in `llama.cpp`, use the following command: ```bash ./llama-cli -m Qwen3-VL-8B-Instruct-Unredacted-MAX.Q4_K_M.gguf \ --mmproj Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-f16.gguf \ --image path/to/your/image....

Note27 aoûthuggingface.co/KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF

Source context: 1235 downloads · 7 likes · Pipeline image-to-text · Library gguf · Repo KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF