ModelAufgelistetExtern

ZwZ 8B GGUF

These are quantizations of the model ZwZ-8B, using a imatrix created from text\en\medium

Quellehuggingface.co/noctrex/ZwZ-8B-GGUF/tree/fc6cca531f9ccd3ccff55cdf3c685a773f3f3f4a

ArtOtherBasismodellinclusionAI/ZwZ-8BVersionRevision fc6cca5

Modellquelle

Art: Other
Dateigröße: 5,10 MB–15,3 GB
Basismodell: inclusionAI/ZwZ-8B
Version: vRevision fc6cca5
Aktualisiert: 25. Sept. 2026
Downloads: 252
Aufgaben: Beschriftung
Quelle: Hugging Face

Quellenbeschreibung

These are quantizations of the model ZwZ-8B, using a imatrix created from text_en_medium

Usage Notes:

Quellen

1 Quelle

Hugging FacePrimärVersion fc6cca531f9ccd3ccff55cdf3c685a773f3f3f4a

huggingface.co/noctrex/ZwZ-8B-GGUF/tree/fc6cca531f9ccd3ccff55cdf3c685a773f3f3f4a

Verifiziert 11. Sept.

Modellartefakte

11 Artefakte

imatrix.gguf

gguf · 5,10 MB · SHA-256 9cd2572aa733…b427 · Hugging Face

Herunterladen

mmproj-BF16.gguf

gguf · 1,08 GB · SHA-256 e592c7557b72…6b6c · Hugging Face

Herunterladen

mmproj-F16.gguf

Quellenauszüge

2 Auszüge

Readme11. Sept.huggingface.co/noctrex/ZwZ-8B-GGUF

--- pipeline_tag: image-to-text base_model: - inclusionAI/ZwZ-8B --- These are quantizations of the model [ZwZ-8B](https://huggingface.co/inclusionAI/ZwZ-8B), using a imatrix created from [text\_en\_medium](https://huggingface.co/datasets/eaddario/imatrix-calibration/blob/main/text_en_medium.parquet) **Usage Notes:** - Download the latest [llama.cpp](https://github.com/ggml-org/llama.cpp) to use these quantizations. - Try to use the best quality you can run. - For the `mmproj` file, the F32 version is recommended for best results (F32 > BF16 > F16).