Qwen3.6 35B A3B Heretic GGUF
Modellquelle
- Art
- Other
- Dateigröße
- 861 MB–64,6 GB
- Basismodell
- Qwen3
- Aktualisiert
- 26. Sept. 2026
- Verleger
- @SassyDiffusion
- Parameter
- 35B
Quellenauszug
Modellartefakte
30 Artefakte
Modellartefakte
30 Artefaktemmproj-Qwen3.6-35B-A3B-heretic.BF16.gguf
gguf · 861 MB · SHA-256 bbba86b64bb3…beab
Qwen3.6-35B-A3B-heretic.BF16.gguf
gguf · 64,6 GB · SHA-256 b31f1c8ca8d3…6c45
Qwen3.6-35B-A3B-heretic.EMB_BF16.IQ1_M.gguf
gguf · 10,0 GB · SHA-256 513018e632c7…a3bc
Qwen3.6-35B-A3B-heretic.EMB_BF16.IQ2_M.gguf
gguf · 11,4 GB · SHA-256 d0da1bdc68f6…5d8e
Qwen3.6-35B-A3B-heretic.EMB_BF16.IQ2_XXS.gguf
gguf · 10,7 GB · SHA-256 a348d92e528d…2a96
Qwen3.6-35B-A3B-heretic.EMB_BF16.IQ3_S.gguf
gguf · 13,3 GB · SHA-256 454b2fa628f7…606b
Qwen3.6-35B-A3B-heretic.EMB_BF16.IQ3_XXS.gguf
gguf · 12,9 GB · SHA-256 a126ad2e0bd1…5d6c
Qwen3.6-35B-A3B-heretic.EMB_BF16.IQ4_NL_XL.gguf
gguf · 18,6 GB · SHA-256 5b03f0110eaf…36d2
Qwen3.6-35B-A3B-heretic.EMB_BF16.IQ4_NL.gguf
gguf · 17,2 GB · SHA-256 eb096567c77f…2c90
Qwen3.6-35B-A3B-heretic.EMB_BF16.IQ4_XS.gguf
gguf · 17,0 GB · SHA-256 58ebad281d0b…82f6
Qwen3.6-35B-A3B-heretic.EMB_BF16.Q2_K_XL.gguf
gguf · 12,1 GB · SHA-256 5b01257df998…677c
Qwen3.6-35B-A3B-heretic.EMB_BF16.Q3_K_XL.gguf
gguf · 16,1 GB · SHA-256 12ad821bcced…0a72
Qwen3.6-35B-A3B-heretic.EMB_BF16.Q4_K_XL.gguf
gguf · 21,3 GB · SHA-256 53f40680ebb3…571f
Qwen3.6-35B-A3B-heretic.EMB_BF16.Q5_K_XL.gguf
gguf · 25,2 GB · SHA-256 85fffd8d3b88…b120
Qwen3.6-35B-A3B-heretic.EMB_BF16.Q6_K_XL.gguf
gguf · 30,1 GB · SHA-256 19ed3f9ceb0d…5eda
Qwen3.6-35B-A3B-heretic.EMB_BF16.Q8_K_XL.gguf
gguf · 36,3 GB · SHA-256 fad5d6e4ffa6…e035
Qwen3.6-35B-A3B-heretic.IQ1_M.gguf
gguf · 9,36 GB · SHA-256 092e5cac9ba3…8c55
Qwen3.6-35B-A3B-heretic.IQ2_M.gguf
gguf · 10,7 GB · SHA-256 fdfecaff966c…e985
Qwen3.6-35B-A3B-heretic.IQ2_XXS.gguf
gguf · 10,0 GB · SHA-256 12f37257cd94…4f4c
Qwen3.6-35B-A3B-heretic.IQ3_S.gguf
gguf · 12,7 GB · SHA-256 7cb5cec96233…4809
Qwen3.6-35B-A3B-heretic.IQ3_XXS.gguf
gguf · 12,3 GB · SHA-256 7ed40936153f…befa
Qwen3.6-35B-A3B-heretic.IQ4_NL_XL.gguf
gguf · 18,2 GB · SHA-256 9ee39a5ff6ee…8573
Qwen3.6-35B-A3B-heretic.IQ4_NL.gguf
gguf · 16,8 GB · SHA-256 981f29f958d0…1b4f
Qwen3.6-35B-A3B-heretic.IQ4_XS.gguf
gguf · 16,5 GB · SHA-256 85b4a7aa09b5…a222
Qwen3.6-35B-A3B-heretic.Q2_K_XL.gguf
gguf · 11,4 GB · SHA-256 7056a7cfa2c9…9b56
Qwen3.6-35B-A3B-heretic.Q3_K_XL.gguf
gguf · 15,7 GB · SHA-256 a56e98627628…87fd
Qwen3.6-35B-A3B-heretic.Q4_K_XL.gguf
gguf · 20,8 GB · SHA-256 29f1fa24f1b2…c439
Qwen3.6-35B-A3B-heretic.Q5_K_XL.gguf
gguf · 24,8 GB · SHA-256 159b21576e1c…4a7e
Qwen3.6-35B-A3B-heretic.Q6_K_XL.gguf
gguf · 29,7 GB · SHA-256 af074e7299fa…d57b
Qwen3.6-35B-A3B-heretic.Q8_K_XL.gguf
gguf · 35,8 GB · SHA-256 56408f7d3909…39fb
Quellenauszüge
3 Auszüge
Quellenauszüge
3 Auszüge--- library_name: gguf license: apache-2.0 license_link: https://huggingface.co/Qwen/Qwen3.6-35B-A3B/blob/main/LICENSE pipeline_tag: image-text-to-text tags: - heretic - uncensored - decensored - abliterated base_model: - llmfan46/Qwen3.6-35B-A3B-uncensored-heretic --- This repo contains the **EMB_BF16** quants, which are quantizations that preserve full precision for embeddings that always stay in system RAM. These embeddings are never copied to GPU VRAM, so they do not contribute to VRAM usage. They're lookup tables that are only accessed a few KB per token so they don't affect RAM bandwidth or computation efficiency either despite their larger size when unquantized. If you're not constrained by system RAM, having these embeddings in full precision may provide better accuracy. These embeddings are: - `token_embd.weight` - `position_embd.weight` - `token_types.weight` - `per_layer_token_embd.weight` For this model, `token_embd.weight` is left unquantized in the `EMB_BF16` quants. --- <div style="background-color: #ff4444; color: white; padding: 20px; border-radius: 10px; text-align: center; margin: 20px 0;"> <h2 style="color: white; margin: 0 0 10px 0;">🚨⚠️ I HAVE REACHED HUGGING FACE'S FREE STORAGE LIMIT ⚠️🚨</h2> <p style="font-size: 18px; margin: 0 0 15px 0;">I can no longer upload new models unless I can cover the cost of additional storage.<br>I host <b>70+ free models</b> as an independent contributor and this work is unpaid.<br><b>Without your support, no more new models can be uploaded.</b></p> <p style="font-size: 20px; margin: 0;"> <a href="https://patreon.com/LLMfan46" style="color: white; text-decoration: underline;">🎉 Patreon (Monthly)</a> | <a href="https://ko-fi.com/llmfan46" style="color: white; text-decoration: underline;">☕ Ko-fi (One-time)</a> </p> <p style="font-size: 16px; margin: 10px 0 0 0;">Every contribution goes directly toward Hugging Face storage fees to keep models free for everyone.</p> </div> --- ### **88% fewer refusals** (10/100 Uncensored vs 83/100 Original) while preserving model quality (0.0015 KL divergence). ## ❤️ Support My Work Creating these models takes significant time, work and compute. If you find them useful consider supporting me: 