--- tags: - gguf - llama.cpp - unsloth --- # gemma-2-2b-4bit-v1 : GGUF This model was finetuned and converted to GGUF format using [Unsloth](https://github.com/unslothai/unsloth). **Example usage**: - For text only LLMs: `llama-cli -hf tbfajri03/gemma-2-2b-4bit-v1 --jinja` - For multimodal models: `llama-mtmd-cli -hf tbfajri03/gemma-2-2b-4bit-v1 --jinja` ## Available Model files: - `gemma-2-2b-it.Q4_K_M.gguf` ## Ollama An Ollama Modelfile is included for easy deployment. ## Note The model's BOS token behavior was adjusted for GGUF compatibility. This was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) [ ](https://github.com/unslothai/unsloth)
