Gemma 4 12B It Assistant 6bit

--- library_name: mlx license: apache-2.0 license_link: https://ai.google.dev/gemma/docs/gemma_4_license pipeline_tag: any-to-any base_model: google/gemma-4-12B-it-assistant tags: - mlx --- # mlx-community/gemma-4-12B-it-assistant-6bit This model was converted to MLX format from [`google/gemma-4-12B-it-assistant`](https://huggingface.co/google/gemma-4-12B-it-assistant) using mlx-vlm version **0.6.0**. Refer to the [original model card](https://huggingface.co/google/gemma-4-12B-it-assistant) for more details on the model. ## Use with mlx ```bash pip install -U mlx-vlm ``` ```bash python -m mlx_vlm.generate --model mlx-community/gemma-4-12B-it-assistant-6bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image> ```

Source context: 49 downloads · 1 likes · Pipeline any-to-any · Library mlx · Repo mlx-community/gemma-4-12B-it-assistant-6bit