--- tags: - gguf - llama.cpp - unsloth --- # cai-model-QG2OMfN2kzf97S0VlPLAp0Tfro73 : GGUF This model was finetuned and converted to GGUF format using [Unsloth](https://github.com/unslothai/unsloth). **Example usage**: - For text only LLMs: `llama-cli -hf WonseokJayJung/cai-model-QG2OMfN2kzf97S0VlPLAp0Tfro73 --jinja` - For multimodal models: `llama-mtmd-cli -hf WonseokJayJung/cai-model-QG2OMfN2kzf97S0VlPLAp0Tfro73 --jinja` ## Available Model files: - `Llama-3.2-3B-Instruct.Q4_K_M.gguf` ## Ollama An Ollama Modelfile is included for easy deployment. This was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) [ ](https://github.com/unslothai/unsloth)
