Bonsai 27b 1bit CRACK GGUF

--- license: apache-2.0 library_name: llama.cpp pipeline_tag: image-text-to-text base_model: prism-ml/Bonsai-27B-gguf base_model_relation: quantized language: - en - zh metrics: - accuracy tags: - gguf - llama.cpp - prismml - bonsai - crack - abliterated - dealigned - uncensored - quantized - vision-language - multimodal - vision - video - hybrid-attention - qwen3.5 - qwen3-vl - qwen3.6 - reasoning - tool-use - conversational - mmlu - harmbench - not-for-all-audiences - 1-bit - binary - q1_0 --- <p align="center"> <img src="./dealign_mascot.png" alt="dealign.ai mascot" width="112">&nbsp;&nbsp;&nbsp; <a href="https://huggingface.co/dealignai"><img src="./dealign_logo.png" alt="dealign.ai" width="480"></a> </p> <h1 align="center">Bonsai 27B 1-bit CRACK GGUF</h1> <p align="center"> <strong>Vision-language · native Q1_0 · Prism llama.cpp</strong><br> 52.50% MMLU-200 logit · 97.81% full HB-320 </p> Native **Q1_0** GGUF release of the Bonsai 27B CRACK model for the [Prism llama.cpp fork](https://github.com/PrismML-Eng/llama.cpp). This repo contains the quantized language model and the matching F16 Qwen3VL multimodal projector. ## Files | File | Purpose | Size | |---|---|---:| | `Bonsai-27b-1bit-CRACK-Q1_0.gguf` | 64-block hybrid language model, Q1_0 | 4.35 GiB | | `mmproj-Bonsai-27b-1bit-CRACK-F16.gguf` | F16 image/video-capable Qwen3VL projector | 0.86 GiB | The projector contains 334 tensors and both temporal patch slices `v.patch_embd.weight` and `v.patch_embd.weight.1` (`temporal_patch_size=2`). The original image and video processor configuration files are included. Image input is live-tested. Direct video-container input depends on the Prism runtime surface; extract frames or use a compatible Qwen3VL video client when the CLI does not accept the container directly. See `preprocessor_config.json` and `video_preprocessor_config.json` for the retained preprocessing metadata. ## Runtime These native low-bit types require the Prism fork: ```bash git clone https://github.com/PrismML-Eng/llama.cpp cd llama.cpp cmake -B build && cmake --build build -j ``` Text: ```bash ./build/bin/llama-cli \ -m Bonsai-27b-1bit-CRACK-Q1_0.gguf \ --reasoning off -ngl 99 -n 256 \ -p "Explain quantum computing in simple terms." ``` Image/VL: ```bash ./build/bin/llama-cli \ -m Bonsai-27b-1bit-CRACK-Q1_0.gguf \ --mmproj mmproj-Bonsai-2...

Source context: 9508 downloads · 21 likes · Pipeline image-text-to-text · Library llama.cpp · Repo dealignai/Bonsai-27b-1bit-CRACK-GGUF