Ir para o conteúdo
ModelVerificadoExterno
Baixar

Mistral Small 4 119B 2603 Heretic GGUF

| Field | Value | | Base Model | Mistral Small 4 119B 2603 by Mistralai | | Heretic Model | Mistral Small 4 119B 2603 Heretic by darkc0de | | Architecture | Mistral4 (MoE, MLA attention) | | Total Parameters | 119B |...

Fontehuggingface.co/Rioky/Mistral-Small-4-119B-2603-heretic-gguf/tree/b3b973b5728c8c176d2c9be6fcfb2e334682033d
TipoOtherModelo basedarkc0de/Mistral-Small-4-119B-2603-hereticVersãoRevision b3b973bPublicador@RiokyCnota

Fonte do modelo

Tipo
Other
Tamanho do arquivo
1,54–222 GB
Modelo base
darkc0de/Mistral-Small-4-119B-2603-heretic
Versão
vRevision b3b973b
Atualizado
1 de out. de 2026
Publicador
@Rioky
Downloads
3 mil
Fonte
Hugging Face

Descrição da fonte

Mistral-Small-4-119B-2603-heretic GGUf Quantizations

Model Information

FieldValue
Base ModelMistral Small 4 119B 2603 by Mistralai
Heretic ModelMistral Small 4 119B 2603 Heretic by darkc0de
ArchitectureMistral4 (MoE, MLA attention)
Total Parameters119B
Active Parameters6.5B per token
Experts128 experts, 4 active
Context Length256k tokens

Key Features

  • MoE Architecture: 128 experts with 4 active per token (6.5B activated parameters)
  • Multimodal: Accepts both text and image input, produces text output
  • Reasoning Mode: Toggle between fast instant reply and reasoning mode with test-time compute
  • Function Calling: Native function calling with JSON output
  • Agentic: Best-in-class agentic capabilities
  • System Prompts: Strong adherence and support for system prompts
  • Speed-Optimized: Best-in-class performance and speed
  • Large Context Window: 256k context length supported
  • Apache 2.0 License: Open-source for commercial and non-commercial use
  • Multilingual: Supports English, French, Spanish, German, Italian, Portuguese, Dutch, Chinese, Japanese, Korean, Arabic and more

Heretic Model Statistics

MetricValue
KL Divergence0.0167 (0 for refusable tokens by definition)
Refusals27/100 (98/100 original model)

Available Quantizations

Standard quantizations without importance matrix (imatrix) optimization.

FileTypeSizeBPWDescription
Mistral-Small-4-119B-2603-heretic-BF16.ggufBF16221.6 GiB16.00Base model, highest quality
Mistral-Small-4-119B-2603-heretic-Q8_0.ggufQ8_0117.8 GiB8.00Very high quality
Mistral-Small-4-119B-2603-heretic-Q6_K.ggufQ6_K91.0 GiB6.00High quality
Mistral-Small-4-119B-2603-heretic-Q5_K_M.ggufQ5_K_M78.5 GiB5.37Good quality/size balance
Mistral-Small-4-119B-2603-heretic-Q5_K_S.ggufQ5_K_S76.3 GiB5.25
Mistral-Small-4-119B-2603-heretic-Q4_K_M.ggufQ4_K_M67.2 GiB4.58Recommended
Mistral-Small-4-119B-2603-heretic-Q4_K_S.ggufQ4_K_S63.1 GiB4.37
Mistral-Small-4-119B-2603-heretic-IQ4_NL.ggufIQ4_NL63.0 GiB4.50Non-linear quantization
Mistral-Small-4-119B-2603-heretic-Q3_K_L.ggufQ3_K_L57.4 GiB3.70
Mistral-Small-4-119B-2603-heretic-Q3_K_M.ggufQ3_K_M53.1 GiB3.63
Mistral-Small-4-119B-2603-heretic-Q3_K_S.ggufQ3_K_S47.8 GiB3.41
Mistral-Small-4-119B-2603-heretic-Q2_K.ggufQ2_K40.4 GiB2.96Low memory usage

Fontes

1 fonte
Hugging FacePrimárioVersão b3b973b5728c8c176d2c9be6fcfb2e334682033d
huggingface.co/Rioky/Mistral-Small-4-119B-2603-heretic-gguf/tree/b3b973b5728c8c176d2c9be6fcfb2e334682033d

Verificado 1 de out.

Artefatos de modelo

14 artefatos

Mistral-Small-4-119B-2603-heretic-BF16.gguf

gguf · 222 GB · SHA-256 c59b4cb4086f…5d19 · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-IQ4_NL.gguf

gguf · 63,0 GB · SHA-256 ae8eca0c0fc9…7aea · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-mmproj-F16.gguf

gguf · 1,56 GB · SHA-256 569cd9e12bdd…41dd · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-mmproj-Q8_0.gguf

gguf · 1,54 GB · SHA-256 69419b790691…dacc · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-Q2_K.gguf

gguf · 40,4 GB · SHA-256 d3051c1819d2…940b · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-Q3_K_L.gguf

gguf · 57,4 GB · SHA-256 a4ab59825560…36bb · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-Q3_K_M.gguf

gguf · 53,0 GB · SHA-256 7bb2ed615e56…f455 · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-Q3_K_S.gguf

gguf · 47,9 GB · SHA-256 33111ea7d62f…935c · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-Q4_K_M.gguf

gguf · 67,2 GB · SHA-256 862f3e15a18f…6ac4 · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-Q4_K_S.gguf

gguf · 63,0 GB · SHA-256 82978b10c3e9…ccd8 · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-Q5_K_M.gguf

gguf · 78,7 GB · SHA-256 c15728b06f46…eada · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-Q5_K_S.gguf

gguf · 76,3 GB · SHA-256 4affe9bd44aa…626a · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-Q6_K.gguf

gguf · 91,0 GB · SHA-256 e955221cc944…7139 · Hugging Face

Baixar

Mistral-Small-4-119B-2603-heretic-Q8_0.gguf

gguf · 118 GB · SHA-256 5672ead34c02…d59d · Hugging Face

Baixar

Trechos de fonte

3 trechos
Readme11 de jul.huggingface.co/Rioky/Mistral-Small-4-119B-2603-heretic-gguf

--- license: apache-2.0 tags: - heretic - uncensored - decensored - mistral-small-4 - 119b - gguf language: - en - fr - de - es - pt - it - ja - ko - zh - ar - fa - id - ms - ne - pl - ro - sr - sv - tr - uk - vi - hi - bn pipeline_tag: image-text-to-text base_model: darkc0de/Mistral-Small-4-119B-2603-heretic datasets: - bartowski1182/calibration_datav5.txt --- # Mistral-Small-4-119B-2603-heretic GGUf Quantizations ## Model Information | Field | Value | |-------|-------| | **Base Model** | [Mistral Small 4 119B 2603](https://huggingface.co/mistralai/Mistral-Small-4-119B-2603) by Mistralai | | **Heretic Model** | [Mistral Small 4 119B 2603 Heretic](https://huggingface.co/darkc0de/Mistral-Small-4-119B-2603-heretic) by darkc0de | | **Architecture** | Mistral4 (MoE, MLA attention) | | **Total Parameters** | 119B | | **Active Parameters** | 6.5B per token | | **Experts** | 128 experts, 4 active | | **Context Length** | 256k tokens | ## Key Features - **MoE Architecture**: 128 experts with 4 active per token (6.5B activated parameters) - **Multimodal**: Accepts both text and image input, produces text output - **Reasoning Mode**: Toggle between fast instant reply and reasoning mode with test-time compute - **Function Calling**: Native function calling with JSON output - **Agentic**: Best-in-class agentic capabilities - **System Prompts**: Strong adherence and support for system prompts - **Speed-Optimized**: Best-in-class performance and speed - **Large Context Window**: 256k context length supported - **Apache 2.0 License**: Open-source for commercial and non-commercial use - **Multilingual**: Supports English, French, Spanish, German, Italian, Portuguese, Dutch, Chinese, Japanese, Korean, Arabic and more ## Heretic Model Statistics | Metric | Value | |--------|-------| | KL Divergence | 0.0167 (0 for refusable tokens by definition) | | Refusals | 27/100 (98/100 original model) | ## Available Quantizations Standard quantizations without importance matrix (imatrix) optimization. | File | Type | Size | BPW | Description | |------|------|------|-----|-------------| | `Mistral-Small-4-119B-2603-heretic-BF16.gguf` | BF16 | 221.6 GiB | 16.00 | Base model, highest quality | | `Mistral-Small-4-119B-2603-heretic-Q8_0.gguf` | Q8_0 | 117.8 GiB | 8.00 | Very high quality | | `Mistral-Small-4-119B-2603-heretic-Q6_K.gguf` | Q6_K | 91....

Note1 de out.huggingface.co/Rioky/Mistral-Small-4-119B-2603-heretic-gguf

Source context: 2990 downloads · 0 likes · Pipeline image-text-to-text · Repo Rioky/Mistral-Small-4-119B-2603-heretic-gguf

Note16 de jul.huggingface.co/Rioky/Mistral-Small-4-119B-2603-heretic-gguf

Source context: 286 downloads · 0 likes · Pipeline image-text-to-text · Repo Rioky/Mistral-Small-4-119B-2603-heretic-gguf