ModelAufgelistetExtern

ZwZ 4B GGUF

These are quantizations of the model ZwZ-4B, using a imatrix created from text\en\medium

Quellehuggingface.co/noctrex/ZwZ-4B-GGUF/tree/cd6da7f111a0f0dc68029fc13e9b819fb4809b9a

ArtOtherBasismodellinclusionAI/ZwZ-4BVersionRevision cd6da7f

Modellquelle

Art: Other
Dateigröße: 3,69 MB–8,22 GB
Basismodell: inclusionAI/ZwZ-4B
Version: vRevision cd6da7f
Aktualisiert: 22. Sept. 2026
Downloads: 51
Aufgaben: Beschriftung
Quelle: Hugging Face

Quellenbeschreibung

These are quantizations of the model ZwZ-4B, using a imatrix created from text_en_medium

Usage Notes:

Quellen

1 Quelle

Hugging FacePrimärVersion cd6da7f111a0f0dc68029fc13e9b819fb4809b9a

huggingface.co/noctrex/ZwZ-4B-GGUF/tree/cd6da7f111a0f0dc68029fc13e9b819fb4809b9a

Verifiziert 11. Sept.

Modellartefakte

11 Artefakte

imatrix.gguf

gguf · 3,69 MB · SHA-256 70a45cd102ed…b18c · Hugging Face

Herunterladen

mmproj-BF16.gguf

gguf · 800 MB · SHA-256 4e800461385f…1074 · Hugging Face

Herunterladen

mmproj-F16.gguf

Quellenauszüge

2 Auszüge

Readme11. Sept.huggingface.co/noctrex/ZwZ-4B-GGUF

--- pipeline_tag: image-to-text base_model: - inclusionAI/ZwZ-4B --- These are quantizations of the model [ZwZ-4B](https://huggingface.co/inclusionAI/ZwZ-4B), using a imatrix created from [text\_en\_medium](https://huggingface.co/datasets/eaddario/imatrix-calibration/blob/main/text_en_medium.parquet) **Usage Notes:** - Download the latest [llama.cpp](https://github.com/ggml-org/llama.cpp) to use these quantizations. - Try to use the best quality you can run. - For the `mmproj` file, the F32 version is recommended for best results (F32 > BF16 > F16).