ModelAufgelistetExtern

Gemma 4 12B It GGUF

> [!IMPORTANT] > This model is automatically converted using

Quellehuggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/e3e681731089efaa3f0917336944ac64752db8ba

ArtOtherBasismodellgoogle/gemma-4-12B-itVersionRevision e3e6817DBewertung

Modellquelle

Art: Other
Dateigröße: 152 MB–22,2 GB
Basismodell: google/gemma-4-12B-it
Version: vRevision e3e6817
Aktualisiert: 9. Okt. 2026
Downloads: 49.627
Quelle: Hugging Face

Quellenbeschreibung

gemma-4-12B-it

Run with https://llama.app

llama serve -hf ggml-org/gemma-4-12B-it-GGUF

Source models

TODOs

add info
add dflash

[!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert

Quellen

1 Quelle

Hugging FacePrimärVersion e3e681731089efaa3f0917336944ac64752db8ba

huggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/e3e681731089efaa3f0917336944ac64752db8ba

Verifiziert 9. Okt.

Modellartefakte

8 Artefakte

gemma-4-12B-it-BF16.gguf

gguf · 22,2 GB · SHA-256 2851bc5b1a24…c292 · Hugging Face

Herunterladen

gemma-4-12B-it-Q4_0.gguf

gguf · 6,72 GB · SHA-256 3712b9bd32ca…7a70 · Hugging Face

Herunterladen

gemma-4-12B-it-Q8_0.gguf

gguf · 11,8 GB · SHA-256 abfc3044b937…33e4 · Hugging Face

Herunterladen

mmproj-gemma-4-12B-it-BF16.gguf

gguf · 167 MB · SHA-256 9b1edfa05b63…fd1d · Hugging Face

Herunterladen

mmproj-gemma-4-12B-it-Q8_0.gguf

gguf · 152 MB · SHA-256 59e62255435d…3738 · Hugging Face

Herunterladen

mtp-gemma-4-12B-it-BF16.gguf

gguf · 822 MB · SHA-256 9b67d8e3650f…f67e · Hugging Face

Herunterladen

mtp-gemma-4-12B-it-Q4_0.gguf

gguf · 242 MB · SHA-256 b894e614824d…7602 · Hugging Face

Herunterladen

mtp-gemma-4-12B-it-Q8_0.gguf

gguf · 444 MB · SHA-256 16c90eb9f2b2…0610 · Hugging Face

Herunterladen

Quellenauszüge

3 Auszüge

Readme1. Aug.huggingface.co/ggml-org/gemma-4-12B-it-GGUF

--- license: apache-2.0 pipeline_tag: any-to-any tags: - gguf - quantized base_model: - google/gemma-4-12B-it --- # gemma-4-12B-it Run with https://llama.app ```bash llama serve -hf ggml-org/gemma-4-12B-it-GGUF ``` ### Source models - https://huggingface.co/google/gemma-4-12B-it - https://huggingface.co/google/gemma-4-12B-it-assistant - https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized-assistant - https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized ### TODOs - add info - add dflash > [!IMPORTANT] > This model is automatically converted using https://github.com/ggml-org/convert

Note9. Okt.huggingface.co/ggml-org/gemma-4-12B-it-GGUF

Source context: 49627 downloads · 93 likes · Pipeline any-to-any · Repo ggml-org/gemma-4-12B-it-GGUF

Note1. Aug.huggingface.co/ggml-org/gemma-4-12B-it-GGUF

Source context: 43563 downloads · 81 likes · Pipeline any-to-any · Repo ggml-org/gemma-4-12B-it-GGUF