Gemma 2 2b 4bit v1

--- tags: - gguf - llama.cpp - unsloth --- # gemma-2-2b-4bit-v1 : GGUF This model was finetuned and converted to GGUF format using [Unsloth](https://github.com/unslothai/unsloth). **Example usage**: - For text only LLMs: `llama-cli -hf tbfajri03/gemma-2-2b-4bit-v1 --jinja` - For multimodal models: `llama-mtmd-cli -hf tbfajri03/gemma-2-2b-4bit-v1 --jinja` ## Available Model files: - `gemma-2-2b-it.Q4_K_M.gguf` ## Ollama An Ollama Modelfile is included for easy deployment. ## Note The model's BOS token behavior was adjusted for GGUF compatibility. This was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)

Source context: 8 downloads · 0 likes · Repo tbfajri03/gemma-2-2b-4bit-v1

Source context: 0 downloads · 0 likes · Repo tbfajri03/gemma-2-2b-4bit-v1