Tvall43 Gemma 4 E2B It Heretic v1

--- library_name: transformers license: apache-2.0 license_link: https://ai.google.dev/gemma/docs/gemma_4_license pipeline_tag: any-to-any tags: - heretic - uncensored - decensored - abliterated base_model: - google/gemma-4-E2B-it --- # This is a decensored version of [google/gemma-4-E2B-it](https://huggingface.co/google/gemma-4-E2B-it), made using [Heretic](https://github.com/p-e-w/heretic) v1.2.0 tried again with mlp. no refusals, but still higher kld than id like. gonna try a bigger model next. ## Abliteration parameters | Parameter | Value | | :-------- | :---: | | **direction_index** | per layer | | **attn.o_proj.max_weights.0** | 0: 0.84 | | **attn.o_proj.max_weights.1** | 1: 1.22 | | **attn.o_proj.max_weights.2** | 2: 1.46 | | **attn.o_proj.max_weights.3** | 3: 1.48 | | **attn.o_proj.max_weight_position** | 32.17 | | **attn.o_proj.min_weights.0** | 0: 0.58 | | **attn.o_proj.min_weights.1** | 1: 0.63 | | **attn.o_proj.min_weights.2** | 2: 0.67 | | **attn.o_proj.min_weights.3** | 3: 0.93 | | **attn.o_proj.min_weight_distance** | 11.43 | | **mlp.down_proj.max_weights.0** | 0: 0.97 | | **mlp.down_proj.max_weights.1** | 1: 0.87 | | **mlp.down_proj.max_weights.2** | 2: 1.36 | | **mlp.down_proj.max_weights.3** | 3: 0.84 | | **mlp.down_proj.max_weight_position** | 28.03 | | **mlp.down_proj.min_weights.0** | 0: 0.95 | | **mlp.down_proj.min_weights.1** | 1: 0.31 | | **mlp.down_proj.min_weights.2** | 2: 0.09 | | **mlp.down_proj.min_weights.3** | 3: 0.37 | | **mlp.down_proj.min_weight_distance** | 4.34 | ## Performance | Metric | This model | Original model ([google/gemma-4-E2B-it](https://huggingface.co/google/gemma-4-E2B-it)) | | :----- | :--------: | :---------------------------: | | **KL divergence** | 0.2459 | 0 *(by definition)* | | **Refusals** | 0/100 | 98/100 | ----- <div align="center"> <img src=https://ai.google.dev/gemma/images/gemma4_banner.png> </div> <p align="center"> <a href="https://huggingface.co/collections/google/gemma-4" target="_blank">Hugging Face</a> | <a href="https://github.com/google-gemma" target="_blank">GitHub</a> | <a href="https://blog.google/innovation-and-ai/technology/developers-tools/gemma-4/" target="_blank">Launch Blog</a> | <a href="https://ai.google.dev/gemma/docs/core" target="_blank">Documentation</a> <br> <b>License</b>: <a href="https://ai.google.dev/gemma/docs/gemma_4_license" target="_blank">Apache...