DFM Mimir

--- library_name: transformers license: apache-2.0 license_name: apache-2.0 license_link: LICENSE language: - da - en pipeline_tag: text-generation tags: - danish - english - foundation-model - instruction-tuned --- <div align="center"> <img src="DFM-logo.png" alt="Danish Foundation Models" width="400"/> </div> # DFM Mimir Current large language model development relies on massive, often non-permissible datasets, creating a high barrier for researchers committed to open-source and ethically sourced data. We introduce Mimir, a **1-billion-parameter** language model based on the Hierarchical Reasoning Model (HRM) architecture, that is trained **from scratch** and delivers highly competitive performance for English and sets a new state of the art for Danish using only permissible post-training data. Trained on a mixture of 161 datasets, comprising approximately **70.479 billion tokens per epoch**. Mimir outperforms the original HRM-Text 1B and competes with larger frontier models like Qwen 3.5 4B and Gemma 4 E2B, tested across 20 benchmarks for English, Math & Code and Danish. ## Evaluation Mimir is evaluated across Danish, English, and Math & Code benchmarks. The figure below shows average performance by subject area across compared models.  ### English benchmark results (Best scores in **bold**.) English benchmark results (full datasets). | Model | BoolQ (Acc) | Winogrande (Acc) | Hellaswag (Acc) | MMLU (Acc) | ARC-C (Acc) | DROP (F1) | GovRep. (R1) | Avg. | | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | | **~1B models** | | | | | | | | | | Mimir 1B | **87.8** | **73.5** | 67.3 | 57.5 | 81.6 | **83.1** | 32.0 | 69.0 | | HRM-Text 1B | 87.5 | 70.4 | 60.4 | 58.7 | 82.2 | 78.1 | 25.4 | 66.1 | | Qwen 3.5 0.8B | 69.8 | 48.9 | 37.0 | 51.5 | 68.4 | 45.2 | 32.5 | 50.5 | | Gemma 3 1B | 62.4 | 49.1 | 30.6 | 37.5 | 43.5 | 7.0 | 29.5 | 37.1 | | OLMo 2 1B | 67.2 | 51.0 | 42.4 | 41.6 | 48.1 | 12.4 | 37.7 | 42.9 | | **2--3B models** | | | | | | | | | | Qwen 3.5 2B | 80.8 | 53.4 | 64.6 | 62.8 | 82.7 | 31.3 | 31.5 | 58.2 | | SmolLM3 3B | 84.3 | 60.3 | 65.1 | 60.2 | 79.5 | 54.0 | **38.1** | 63.1 | | **4--5B models** | | | | | | | | | | Qwen 3.5 4B | 87.0 | 70.0 | **83.2** | **75.8** | **92.9** | 48.0 | 27.9 | **69.3** | | Gemma 4 E2B | 64.1 | 56.7 | 55.6 | 59.3 | 69.8 | 5...