Model source
Source excerpt
Model artifacts
25 artifactsDans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ1_M.gguf
gguf · 3.00 GB · SHA-256 49ac4478b58c…58c7
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ1_S.gguf
gguf · 2.79 GB · SHA-256 659d7d3f771e…4594
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ2_M.gguf
gguf · 4.13 GB · SHA-256 56b6d0c11270…2c89
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ2_S.gguf
gguf · 3.85 GB · SHA-256 d06bb641a8e0…a22a
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ2_XS.gguf
Source excerpts
3 excerptsgguf · 3.65 GB · SHA-256 8490cb935161…938e
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ2_XXS.gguf
gguf · 3.35 GB · SHA-256 900f4f8f8b09…2fd0
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ3_M.gguf
gguf · 5.33 GB · SHA-256 0b06311de2d4…1cd5
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ3_S.gguf
gguf · 5.18 GB · SHA-256 74c01adfd2ed…9cd7
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ3_XS.gguf
gguf · 4.94 GB · SHA-256 c3b7f74e9565…f808
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ3_XXS.gguf
gguf · 4.61 GB · SHA-256 af2519128434…f6fb
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ4_NL.gguf
gguf · 6.61 GB · SHA-256 9f590284e433…8458
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ4_XS.gguf
gguf · 6.28 GB · SHA-256 1dcda54eee04…4a33
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q2_K_S.gguf
gguf · 4.19 GB · SHA-256 90ea7ba6c61c…2d93
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q2_K.gguf
gguf · 4.46 GB · SHA-256 7baed126d20b…8f16
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q3_K_L.gguf
gguf · 6.11 GB · SHA-256 d35dc0eea5af…06e0
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q3_K_M.gguf
gguf · 5.67 GB · SHA-256 bd2e2f965447…1a44
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q3_K_S.gguf
gguf · 5.15 GB · SHA-256 56d6e43d9908…03b3
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q4_0.gguf
gguf · 6.61 GB · SHA-256 2e7aacfe6124…a060
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q4_1.gguf
gguf · 7.26 GB · SHA-256 43420de5f04f…7af1
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q4_K_M.gguf
gguf · 6.96 GB · SHA-256 b4d0ee584ba8…66b1
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q4_K_S.gguf
gguf · 6.63 GB · SHA-256 31fc3a0c3397…7be0
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q5_K_M.gguf
gguf · 8.13 GB · SHA-256 9de19061d43f…430e
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q5_K_S.gguf
gguf · 7.93 GB · SHA-256 0aa69c620643…8cab
Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-Q6_K.gguf
gguf · 9.37 GB · SHA-256 12558c419170…3b76
Dans-PersonalityEngine-V1.3.0-12B-Heretic.imatrix.gguf
gguf · 6.76 MB · SHA-256 87c3b56f7110…b267
--- base_model: Sorihon/Dans-PersonalityEngine-V1.3.0-12B-Heretic language: - en library_name: transformers mradermacher: readme_rev: 1 quantized_by: mradermacher --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: nicoboss --> <!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S --> <!-- ### quants_skip: --> <!-- ### skip_mmproj: --> weighted/imatrix quants of https://huggingface.co/Sorihon/Dans-PersonalityEngine-V1.3.0-12B-Heretic <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Dans-PersonalityEngine-V1.3.0-12B-Heretic-i1-GGUF).*** static quants are available at https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.3.0-12B-Heretic-GGUF ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.3.0-12B-Heretic-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.3.0-12B-Heretic.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | | [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.3.0-12B-Heretic-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate | | [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.3.0-12B-Heretic-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate | | [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.3.0-12B-Heretic-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | | | [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.3.0-12B-Heretic-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.3.0-12B-Heretic.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4....
Source context: 93 downloads · 1 likes · Library transformers · Repo mradermacher/Dans-PersonalityEngine-V1.3.0-12B-Heretic-i1-GGUF
Source context: 113 downloads · 1 likes · Library transformers · Repo mradermacher/Dans-PersonalityEngine-V1.3.0-12B-Heretic-i1-GGUF