ModelVérifiéExterne

Mistral Small 4 119B 2603 Heretic GGUF

Sourcehuggingface.co/Rioky/Mistral-Small-4-119B-2603-heretic-gguf/tree/b3b973b5728c8c176d2c9be6fcfb2e334682033d

TypeOtherModèle de basedarkc0de/Mistral-Small-4-119B-2603-hereticVersionRevision b3b973bÉditeur@RiokyCClasse

Source du modèle

Type: Other
Taille du fichier: 1,54–222 GB
Modèle de base: darkc0de/Mistral-Small-4-119B-2603-heretic
Version: vRevision b3b973b
Mis à jour: 1 oct. 2026
Éditeur: @Rioky
Téléchargements: 3 k
Source: Hugging Face

Description de la source

Mistral-Small-4-119B-2603-heretic GGUf Quantizations

Model Information

Field	Value
Base Model	Mistral Small 4 119B 2603 by Mistralai
Heretic Model	Mistral Small 4 119B 2603 Heretic by darkc0de
Architecture	Mistral4 (MoE, MLA attention)
Total Parameters	119B
Active Parameters	6.5B per token
Experts	128 experts, 4 active
Context Length	256k tokens

Key Features

MoE Architecture: 128 experts with 4 active per token (6.5B activated parameters)
Multimodal: Accepts both text and image input, produces text output
Reasoning Mode: Toggle between fast instant reply and reasoning mode with test-time compute
Function Calling: Native function calling with JSON output
Agentic: Best-in-class agentic capabilities
System Prompts: Strong adherence and support for system prompts
Speed-Optimized: Best-in-class performance and speed
Large Context Window: 256k context length supported
Apache 2.0 License: Open-source for commercial and non-commercial use
Multilingual: Supports English, French, Spanish, German, Italian, Portuguese, Dutch, Chinese, Japanese, Korean, Arabic and more

Heretic Model Statistics

Metric	Value
KL Divergence	0.0167 (0 for refusable tokens by definition)
Refusals	27/100 (98/100 original model)

Available Quantizations

Standard quantizations without importance matrix (imatrix) optimization.

File	Type	Size	BPW	Description
`Mistral-Small-4-119B-2603-heretic-BF16.gguf`	BF16	221.6 GiB	16.00	Base model, highest quality
`Mistral-Small-4-119B-2603-heretic-Q8_0.gguf`	Q8_0	117.8 GiB	8.00	Very high quality
`Mistral-Small-4-119B-2603-heretic-Q6_K.gguf`	Q6_K	91.0 GiB	6.00	High quality
`Mistral-Small-4-119B-2603-heretic-Q5_K_M.gguf`	Q5_K_M	78.5 GiB	5.37	Good quality/size balance
`Mistral-Small-4-119B-2603-heretic-Q5_K_S.gguf`	Q5_K_S	76.3 GiB	5.25
`Mistral-Small-4-119B-2603-heretic-Q4_K_M.gguf`	Q4_K_M	67.2 GiB	4.58	Recommended
`Mistral-Small-4-119B-2603-heretic-Q4_K_S.gguf`	Q4_K_S	63.1 GiB	4.37
`Mistral-Small-4-119B-2603-heretic-IQ4_NL.gguf`	IQ4_NL	63.0 GiB	4.50	Non-linear quantization
`Mistral-Small-4-119B-2603-heretic-Q3_K_L.gguf`	Q3_K_L	57.4 GiB	3.70
`Mistral-Small-4-119B-2603-heretic-Q3_K_M.gguf`	Q3_K_M	53.1 GiB	3.63
`Mistral-Small-4-119B-2603-heretic-Q3_K_S.gguf`	Q3_K_S	47.8 GiB	3.41
`Mistral-Small-4-119B-2603-heretic-Q2_K.gguf`	Q2_K	40.4 GiB	2.96	Low memory usage

Sources

1 source

Hugging FacePrincipalVersion b3b973b5728c8c176d2c9be6fcfb2e334682033d

huggingface.co/Rioky/Mistral-Small-4-119B-2603-heretic-gguf/tree/b3b973b5728c8c176d2c9be6fcfb2e334682033d

Vérifié 1 oct.

Artefacts du modèle

14 artefacts

Mistral-Small-4-119B-2603-heretic-BF16.gguf

gguf · 222 GB · SHA-256 c59b4cb4086f…5d19 · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-IQ4_NL.gguf

gguf · 63,0 GB · SHA-256 ae8eca0c0fc9…7aea · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-mmproj-F16.gguf

gguf · 1,56 GB · SHA-256 569cd9e12bdd…41dd · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-mmproj-Q8_0.gguf

gguf · 1,54 GB · SHA-256 69419b790691…dacc · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-Q2_K.gguf

gguf · 40,4 GB · SHA-256 d3051c1819d2…940b · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-Q3_K_L.gguf

gguf · 57,4 GB · SHA-256 a4ab59825560…36bb · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-Q3_K_M.gguf

gguf · 53,0 GB · SHA-256 7bb2ed615e56…f455 · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-Q3_K_S.gguf

gguf · 47,9 GB · SHA-256 33111ea7d62f…935c · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-Q4_K_M.gguf

gguf · 67,2 GB · SHA-256 862f3e15a18f…6ac4 · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-Q4_K_S.gguf

gguf · 63,0 GB · SHA-256 82978b10c3e9…ccd8 · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-Q5_K_M.gguf

gguf · 78,7 GB · SHA-256 c15728b06f46…eada · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-Q5_K_S.gguf

gguf · 76,3 GB · SHA-256 4affe9bd44aa…626a · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-Q6_K.gguf

gguf · 91,0 GB · SHA-256 e955221cc944…7139 · Hugging Face

Télécharger

Mistral-Small-4-119B-2603-heretic-Q8_0.gguf

gguf · 118 GB · SHA-256 5672ead34c02…d59d · Hugging Face

Télécharger

Extraits de sources

3 extraits

Readme11 juil.huggingface.co/Rioky/Mistral-Small-4-119B-2603-heretic-gguf

--- license: apache-2.0 tags: - heretic - uncensored - decensored - mistral-small-4 - 119b - gguf language: - en - fr - de - es - pt - it - ja - ko - zh - ar - fa - id - ms - ne - pl - ro - sr - sv - tr - uk - vi - hi - bn pipeline_tag: image-text-to-text base_model: darkc0de/Mistral-Small-4-119B-2603-heretic datasets: - bartowski1182/calibration_datav5.txt --- # Mistral-Small-4-119B-2603-heretic GGUf Quantizations ## Model Information | Field | Value | |-------|-------| | **Base Model** | [Mistral Small 4 119B 2603](https://huggingface.co/mistralai/Mistral-Small-4-119B-2603) by Mistralai | | **Heretic Model** | [Mistral Small 4 119B 2603 Heretic](https://huggingface.co/darkc0de/Mistral-Small-4-119B-2603-heretic) by darkc0de | | **Architecture** | Mistral4 (MoE, MLA attention) | | **Total Parameters** | 119B | | **Active Parameters** | 6.5B per token | | **Experts** | 128 experts, 4 active | | **Context Length** | 256k tokens | ## Key Features - **MoE Architecture**: 128 experts with 4 active per token (6.5B activated parameters) - **Multimodal**: Accepts both text and image input, produces text output - **Reasoning Mode**: Toggle between fast instant reply and reasoning mode with test-time compute - **Function Calling**: Native function calling with JSON output - **Agentic**: Best-in-class agentic capabilities - **System Prompts**: Strong adherence and support for system prompts - **Speed-Optimized**: Best-in-class performance and speed - **Large Context Window**: 256k context length supported - **Apache 2.0 License**: Open-source for commercial and non-commercial use - **Multilingual**: Supports English, French, Spanish, German, Italian, Portuguese, Dutch, Chinese, Japanese, Korean, Arabic and more ## Heretic Model Statistics | Metric | Value | |--------|-------| | KL Divergence | 0.0167 (0 for refusable tokens by definition) | | Refusals | 27/100 (98/100 original model) | ## Available Quantizations Standard quantizations without importance matrix (imatrix) optimization. | File | Type | Size | BPW | Description | |------|------|------|-----|-------------| | `Mistral-Small-4-119B-2603-heretic-BF16.gguf` | BF16 | 221.6 GiB | 16.00 | Base model, highest quality | | `Mistral-Small-4-119B-2603-heretic-Q8_0.gguf` | Q8_0 | 117.8 GiB | 8.00 | Very high quality | | `Mistral-Small-4-119B-2603-heretic-Q6_K.gguf` | Q6_K | 91....

Note1 oct.huggingface.co/Rioky/Mistral-Small-4-119B-2603-heretic-gguf

Source context: 2990 downloads · 0 likes · Pipeline image-text-to-text · Repo Rioky/Mistral-Small-4-119B-2603-heretic-gguf

Note16 juil.huggingface.co/Rioky/Mistral-Small-4-119B-2603-heretic-gguf

Source context: 286 downloads · 0 likes · Pipeline image-text-to-text · Repo Rioky/Mistral-Small-4-119B-2603-heretic-gguf