GGUF quantizations of empero-ai/Qwythos-9B-Claude-Mythos-5-1M for llama.cpp, Ollama, LM Studio, jan, KoboldCpp, and other GGUF runtimes.
Source du modèle
Extrait de la source
GGUF quantizations of empero-ai/Qwythos-9B-Claude-Mythos-5-1M for llama.cpp, Ollama, LM Studio, jan, KoboldCpp, and other GGUF runtimes.
Sources
1 sourceVérifié 11 sept.
Artefacts du modèle
11 artefactsmmproj-Qwythos-9B-Claude-Mythos-5-1M-F16.gguf
gguf · 876 MB · SHA-256 f977efc337a2…c82c · Hugging Face
TéléchargerQwythos-9B-Claude-Mythos-5-1M-BF16.gguf
gguf · 16,7 GB · SHA-256 8a1d1d5dbc6b…f1cb · Hugging Face
TéléchargerExtraits de sources
2 extraitsQwythos-9B-Claude-Mythos-5-1M-MTP-BF16.gguf
gguf · 17,1 GB · SHA-256 f188232e7e19…eeb3 · Hugging Face
TéléchargerQwythos-9B-Claude-Mythos-5-1M-MTP-Q4_K_M.gguf
gguf · 5,48 GB · SHA-256 318caed45110…4f98 · Hugging Face
TéléchargerQwythos-9B-Claude-Mythos-5-1M-MTP-Q5_K_M.gguf
gguf · 6,26 GB · SHA-256 a21b7f12f990…cd8e · Hugging Face
TéléchargerQwythos-9B-Claude-Mythos-5-1M-MTP-Q6_K.gguf
gguf · 7,09 GB · SHA-256 b6ca7dc848d9…81e9 · Hugging Face
TéléchargerQwythos-9B-Claude-Mythos-5-1M-MTP-Q8_0.gguf
gguf · 9,11 GB · SHA-256 9a8f04df5b8b…9513 · Hugging Face
TéléchargerQwythos-9B-Claude-Mythos-5-1M-Q4_K_M.gguf
gguf · 5,24 GB · SHA-256 5c09e7f207d2…acd5 · Hugging Face
TéléchargerQwythos-9B-Claude-Mythos-5-1M-Q5_K_M.gguf
gguf · 6,02 GB · SHA-256 20013a03b23d…aab7 · Hugging Face
TéléchargerQwythos-9B-Claude-Mythos-5-1M-Q6_K.gguf
gguf · 6,85 GB · SHA-256 2bef47eee2e8…31e6 · Hugging Face
TéléchargerQwythos-9B-Claude-Mythos-5-1M-Q8_0.gguf
gguf · 8,87 GB · SHA-256 e8118b9cde68…8b70 · Hugging Face
Télécharger--- license: apache-2.0 base_model: empero-ai/Qwythos-9B-Claude-Mythos-5-1M base_model_relation: quantized language: - en pipeline_tag: image-text-to-text library_name: gguf tags: - gguf - llama.cpp - quantized - qwen3.5 - reasoning - uncensored - long-context - 1M-context - function-calling - multimodal - vision - cybersecurity - biomedical - agentic --- <p align="center"> <img src="https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/assets/qwythos.png" alt="Qwythos-9B" width="640"/> </p> # Qwythos-9B-Claude-Mythos-5-1M-GGUF **Developed by [Empero](https://empero.org)** GGUF quantizations of **[empero-ai/Qwythos-9B-Claude-Mythos-5-1M](https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M)** for [llama.cpp](https://github.com/ggml-org/llama.cpp), Ollama, LM Studio, jan, KoboldCpp, and other GGUF runtimes. Qwythos-9B is a full-parameter reasoning model post-trained on over 500 million tokens of high-quality Claude Mythos / Claude Fable traces with chain-of-thought generated in-house by Empero AI's internal `rethink` tool. It dominates the base Qwen3.5-9B under matched evaluation (**+34 pts MMLU, +30 pts gsm8k-strict, +19 pts gsm8k-flex**), supports **native function calling** per the Qwen3.5 spec, and ships with a **1,048,576-token (1M) context window** via YaRN rope-scaling enabled by default. For full training details, evaluation numbers, and capability writeup, see the **[base model card](https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M)**. --- ## Files ### Normal text weights — fixed v3 replacements | File | Quant | Size | Notes | |---|---|---|---| | `Qwythos-9B-Claude-Mythos-5-1M-Q4_K_M.gguf` | Q4_K_M | 5.24 GiB / 5.63 GB | **recommended default** — fixed v3, best compatibility | | `Qwythos-9B-Claude-Mythos-5-1M-Q5_K_M.gguf` | Q5_K_M | 6.02 GiB / 6.47 GB | fixed v3, balanced quality / size | | `Qwythos-9B-Claude-Mythos-5-1M-Q6_K.gguf` | Q6_K | 6.85 GiB / 7.36 GB | fixed v3, high quality | | `Qwythos-9B-Claude-Mythos-5-1M-Q8_0.gguf` | Q8_0 | 8.87 GiB / 9.53 GB | fixed v3, near-lossless | | `Qwythos-9B-Claude-Mythos-5-1M-BF16.gguf` | BF16 | 16.69 GiB / 17.92 GB | fixed v3, full precision conversion base | If you don't know which to pick, **Q4_K_M is the right starting point** — it's the smallest practical quant with good quality preservation. ### MTP-enabled text weights — fixed v3 variants Th...
Source context: 135 downloads · 0 likes · Pipeline image-text-to-text · Library gguf · Repo Darkside777baby/Qwythos-9B-Claude-Mythos-5-1M-GGUF