Gemma 4 12B It GGUF
> [!IMPORTANT] > This model is automatically converted using
Model source
- Kind
- Other
- File size
- 152 MB–22.2 GB
- Base model
- google/gemma-4-12B-it
- Version
- vRevision e3e6817
- Updated
- Oct 9, 2026
- Downloads
- 49.6K
- Source
- Hugging Face
Source description
gemma-4-12B-it
Run with https://llama.app
llama serve -hf ggml-org/gemma-4-12B-it-GGUF
Source models
- https://huggingface.co/google/gemma-4-12B-it
- https://huggingface.co/google/gemma-4-12B-it-assistant
- https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized-assistant
- https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized
TODOs
- add info
- add dflash
[!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert
Sources
1 source
Sources
1 sourceVerified Oct 9
Model artifacts
8 artifacts
Model artifacts
8 artifactsSource excerpts
3 excerpts
Source excerpts
3 excerpts--- license: apache-2.0 pipeline_tag: any-to-any tags: - gguf - quantized base_model: - google/gemma-4-12B-it --- # gemma-4-12B-it Run with https://llama.app ```bash llama serve -hf ggml-org/gemma-4-12B-it-GGUF ``` ### Source models - https://huggingface.co/google/gemma-4-12B-it - https://huggingface.co/google/gemma-4-12B-it-assistant - https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized-assistant - https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized ### TODOs - add info - add dflash > [!IMPORTANT] > This model is automatically converted using https://github.com/ggml-org/convert
Source context: 49627 downloads · 93 likes · Pipeline any-to-any · Repo ggml-org/gemma-4-12B-it-GGUF
Source context: 43563 downloads · 81 likes · Pipeline any-to-any · Repo ggml-org/gemma-4-12B-it-GGUF
