Skip to content
ModelListedExternal
Download

Gemma 4 26B A4B It GGUF

Using non-standard (forked) [LLaMA C++][llm] release [b8838][llm-rel] for quantization.

KindOtherBase modelgoogle/gemma-4-26B-A4B-itVersionRevision 70b5389

Model source

Kind
Other
File size
109 MB–47.0 GB
Base model
google/gemma-4-26B-A4B-it
Version
vRevision 70b5389
Updated
Sep 15, 2026
Downloads
624
Source
Hugging Face

Source excerpt

Using non-standard (forked) [LLaMA C++][llm] release [b8838][llm-rel] for quantization.

Sources

1 source
Hugging FacePrimaryVersion 70b5389a2b5d4041e07949cbb5e377a9dc7e0090
huggingface.co/eaddario/gemma-4-26B-A4B-it-GGUF/tree/70b5389a2b5d4041e07949cbb5e377a9dc7e0090

Verified Sep 15

Model artifacts

11 artifacts

gemma-4-26B-A4B-it-F16.gguf

gguf · 47.0 GB · SHA-256 d73341c5fb1e…5025 · Hugging Face

Download

gemma-4-26B-A4B-it-Q2_K.gguf

gguf · 7.40 GB · SHA-256 13e7fb2d5b54…ae21 · Hugging Face

Download

gemma-4-26B-A4B-it-Q3_K.gguf

gguf · 10.3 GB · SHA-256 6b321f332cc8…e036 · Hugging Face

Download

gemma-4-26B-A4B-it-Q4_K.gguf

gguf · 13.2 GB · SHA-256 f3213c68ee24…efae · Hugging Face

Download

gemma-4-26B-A4B-it-Q5_K.gguf

gguf · 16.2 GB · SHA-256 eae4ee26e9ec…3796 · Hugging Face

Download

gemma-4-26B-A4B-it-Q6_K.gguf

gguf · 19.1 GB · SHA-256 9330760535d5…3079 · Hugging Face

Download

gemma-4-26B-A4B-it-Q7_K.gguf

gguf · 22.0 GB · SHA-256 521d6805eb66…348c · Hugging Face

Download

gemma-4-26B-A4B-it-Q8_0.gguf

gguf · 25.0 GB · SHA-256 1e149ee034e2…3dbb · Hugging Face

Download

imatrix/imatrix-gemma-4-26B-A4B-it-medium.gguf

gguf · 109 MB · SHA-256 f61f53ca0f9c…ab8d · Hugging Face

Download

mmproj-gemma-4-26B-A4B-it-F16.gguf

gguf · 1.11 GB · SHA-256 41cdabd1e806…975f · Hugging Face

Download

mmproj-gemma-4-26B-A4B-it-F32.gguf

gguf · 2.13 GB · SHA-256 fb8bc849430b…dd8a · Hugging Face

Download

Source excerpts

2 excerpts

--- base_model: - google/gemma-4-26B-A4B-it datasets: - eaddario/imatrix-calibration language: - en license: - apache-2.0 pipeline_tag: any-to-any tags: - gguf - quant - experimental - target_bpw --- # Experimental global target bits‑per‑weight quantization of [google/gemma-4-26B-A4B-it][base] Using **non-standard** (forked) [LLaMA C++][llm] release [b8838][llm-rel] for quantization. Original model: [google/gemma-4-26B-A4B-it][mdl] From the original model creators: > <div align="center"> > <img src=https://ai.google.dev/gemma/images/gemma4_banner.png> > </div> > > <p align="center"> > <a href="https://huggingface.co/collections/google/gemma-4" target="_blank">Hugging Face</a> | > <a href="https://github.com/google-gemma" target="_blank">GitHub</a> | > <a href="https://blog.google/innovation-and-ai/technology/developers-tools/gemma-4/" target="_blank">Launch Blog</a> | > <a href="https://ai.google.dev/gemma/docs/core" target="_blank">Documentation</a> > <br> > <b>License</b>: <a href="https://ai.google.dev/gemma/docs/gemma_4_license" target="_blank">Apache 2.0</a> | <b>Authors</b>: <a href="https://deepmind.google/models/gemma/" target="_blank">Google DeepMind</a> > </p> > > Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on small models) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. > > Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in four distinct sizes: **E2B**, **E4B**, **26B A4B**, and **31B**. Their diverse sizes make them deployable in environments ranging from high-end phones to laptops and servers, democratizing access to state-of-the-art AI. > > Gemma 4 introduces key **capability and architectural advancements**: > > * **Reasoning** – All models in the family are designed as highly capable reasoners, with configurable thinking modes. > > * **Extended Multimodalities** – Processes Text, Image with variable aspect ratio and resolution support (all models), Video, and Audio (featured natively on the E2B and E4B models). > > * **Diverse & Efficient...

Source context: 624 downloads · 0 likes · Pipeline any-to-any · Repo eaddario/gemma-4-26B-A4B-it-GGUF