Zum Inhalt springen
ModelAufgelistetExtern
Herunterladen

Qwen3 VL 8B Instruct Unredacted MAX Quants GGUF

This repository contains high-quality GGUF quantizations for the prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX model.

Quellehuggingface.co/KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF/tree/d2db200bba5cc65c50959a5d5624e34d6cc8e7bc
ArtOtherBasismodellprithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAXVersionRevision d2db200BBewertung

Modellquelle

Art
Other
Dateigröße
717 MB–15,3 GB
Basismodell
prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX
Version
vRevision d2db200
Aktualisiert
11. Okt. 2026
Downloads
1235
Quelle
Hugging Face

Quellenbeschreibung

1

Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF

This repository contains high-quality GGUF quantizations for the prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX model.

Highlights

  • Unredacted & MAX: Maximum performance version without restrictive filters.
  • Full Vision Support: Includes multiple versions of the vision projector (mmproj) for different hardware needs.
  • Optimized: Compatible with the latest llama.cpp and other GGUF-supported backends.

Files Included

1. Model Weights (LLM)

FilenameQuant MethodDescription
Q4_K_M.ggufQ4_K_MRecommended. Best balance of speed and intelligence.
Q8_0.ggufQ8_0High quality, nearly identical to original weights.
Q6_K.ggufQ6_KVery high quality, slightly slower than Q4.
Q5_K_M.ggufQ5_K_MGood balance between Q4 and Q6.
Q3_K_M.ggufQ3_K_MLow size, moderate quality loss.
Q2_K.ggufQ2_KSmallest possible size, significant quality loss.
F16.ggufF16Baseline reference quality.

2. Vision Projectors (mmproj)

Required for image recognition tasks.

FilenameTypeDescription
mmproj-f32.ggufF32Absolute maximum precision (2.3GB).
mmproj-f16.ggufF16Industry standard for high-quality vision.
mmproj-bf16.ggufBF16Optimized for modern NVIDIA GPUs (Ampere+).
mmproj-q8_0.ggufQ8_0Best for saving VRAM without losing recognition detail.

Usage

To use vision capabilities in llama.cpp, use the following command:

./llama-cli -m Qwen3-VL-8B-Instruct-Unredacted-MAX.Q4_K_M.gguf \
            --mmproj Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-f16.gguf \
            --image path/to/your/image.jpg \
            -p "Describe this image"

Quellen

1 Quelle
Hugging FacePrimärVersion d2db200bba5cc65c50959a5d5624e34d6cc8e7bc
huggingface.co/KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF/tree/d2db200bba5cc65c50959a5d5624e34d6cc8e7bc

Verifiziert 27. Aug.

Modellartefakte

14 Artefakte

Qwen3-VL-8B-Instruct-Unredacted-MAX.F16.gguf

gguf · 15,3 GB · SHA-256 5f01c6e4fa7c…f11a · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-bf16.gguf

gguf · 1,08 GB · SHA-256 cfeeb05fd175…01bd · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-f16.gguf

gguf · 1,08 GB · SHA-256 c3ebc2452746…6f4d · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-f32.gguf

gguf · 2,15 GB · SHA-256 52f312496b8e…9a42 · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-q8_0.gguf

gguf · 717 MB · SHA-256 89569d776537…d090 · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q2_K.gguf

gguf · 3,06 GB · SHA-256 7dc185c46446…7327 · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q3_K_L.gguf

gguf · 4,13 GB · SHA-256 f1ff47b24713…74eb · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q3_K_M.gguf

gguf · 3,84 GB · SHA-256 7d9c61e33527…5862 · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q4_K_M.gguf

gguf · 4,68 GB · SHA-256 79b2d3dd474e…600b · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q4_K_S.gguf

gguf · 4,47 GB · SHA-256 c74ab4d05b7f…0439 · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q5_K_M.gguf

gguf · 5,45 GB · SHA-256 b4f06532b484…585f · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q5_K_S.gguf

gguf · 5,33 GB · SHA-256 755b91a88ad4…317c · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q6_K.gguf

gguf · 6,26 GB · SHA-256 67aed8a6ac85…7a2e · Hugging Face

Herunterladen

Qwen3-VL-8B-Instruct-Unredacted-MAX.Q8_0.gguf

gguf · 8,11 GB · SHA-256 f01e2918d966…9687 · Hugging Face

Herunterladen

Quellenauszüge

2 Auszüge
Readme27. Aug.huggingface.co/KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF

--- license: apache-2.0 language: - en - ru - zh tags: - vision - multimodal - gguf - qwen - qwen-3 - unredacted - image-to-text - text-generation - conversational - roleplay - assistant - vl - vlm pipeline_tag: image-to-text library_name: gguf base_model: - prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX --- ![1](https://camo.githubusercontent.com/17b4379eedbf639f0fc005e6512f2a629b9cb059d3cc4eacc1ec65fa21f92898/68747470733a2f2f7169616e77656e2d7265732e6f73732d616363656c65726174652e616c6979756e63732e636f6d2f5177656e332d564c2f7177656e33766c6c6f676f2e706e67) # Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF This repository contains high-quality GGUF quantizations for the [prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX](https://huggingface.co/prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX) model. ## Highlights - **Unredacted & MAX**: Maximum performance version without restrictive filters. - **Full Vision Support**: Includes multiple versions of the vision projector (`mmproj`) for different hardware needs. - **Optimized**: Compatible with the latest `llama.cpp` and other GGUF-supported backends. ## Files Included ### 1. Model Weights (LLM) | Filename | Quant Method | Description | | :--- | :--- | :--- | | `Q4_K_M.gguf` | Q4_K_M | **Recommended.** Best balance of speed and intelligence. | | `Q8_0.gguf` | Q8_0 | High quality, nearly identical to original weights. | | `Q6_K.gguf` | Q6_K | Very high quality, slightly slower than Q4. | | `Q5_K_M.gguf` | Q5_K_M | Good balance between Q4 and Q6. | | `Q3_K_M.gguf` | Q3_K_M | Low size, moderate quality loss. | | `Q2_K.gguf` | Q2_K | Smallest possible size, significant quality loss. | | `F16.gguf` | F16 | Baseline reference quality. | ### 2. Vision Projectors (mmproj) *Required for image recognition tasks.* | Filename | Type | Description | | :--- | :--- | :--- | | `mmproj-f32.gguf` | F32 | Absolute maximum precision (2.3GB). | | `mmproj-f16.gguf` | F16 | Industry standard for high-quality vision. | | `mmproj-bf16.gguf` | BF16 | Optimized for modern NVIDIA GPUs (Ampere+). | | `mmproj-q8_0.gguf` | Q8_0 | Best for saving VRAM without losing recognition detail. | ## Usage To use vision capabilities in `llama.cpp`, use the following command: ```bash ./llama-cli -m Qwen3-VL-8B-Instruct-Unredacted-MAX.Q4_K_M.gguf \ --mmproj Qwen3-VL-8B-Instruct-Unredacted-MAX.mmproj-f16.gguf \ --image path/to/your/image....

Note27. Aug.huggingface.co/KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF

Source context: 1235 downloads · 7 likes · Pipeline image-to-text · Library gguf · Repo KuroTo4ka/Qwen3-VL-8B-Instruct-Unredacted-MAX-Quants-GGUF