¿Tienes un flujo de trabajo de ComfyUI? Obtén un Workflow Doc legible en tu navegador.Haz legible un flujo de trabajo.Pruébalo ahora ↗
One run of the M5 reward-shape x seed ablation (M9.5f). Qwen3.5-0.8B trained with GRPO + a Wikipedia search tool on MuSiQue; this run uses the EM-only reward at seed 43 on Blackwell.
Fuente del modelo
Extracto de la fuente
One run of the M5 reward-shape x seed ablation (M9.5f). Qwen3.5-0.8B trained with GRPO + a Wikipedia search tool on MuSiQue; this run uses the EM-only reward at seed 43 on Blackwell.
Fuentes
1 fuenteVerificado 6 ago
Artefactos del modelo
64 artefactosExtractos de fuentes
3 extractosstep_10/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 8c39bded235e…f92c · Hugging Face
Descargarstep_10/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 48bb71b4bc4f…2017 · Hugging Face
Descargarstep_10/policy/weights/model/shard-00004-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 a803ebaf5737…ef54 · Hugging Face
Descargarstep_100/policy/weights/model/consolidated/model-00001-of-00001.safetensors
safetensors · 3,18 GB · SHA-256 83fabd536df4…2462 · Hugging Face
Descargarstep_100/policy/weights/model/shard-00001-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 3cbde412a59b…f2b0 · Hugging Face
Descargarstep_100/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 8f424f902a0e…6432 · Hugging Face
Descargarstep_100/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 47e37ae47331…bb10 · Hugging Face
Descargarstep_100/policy/weights/model/shard-00004-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 5a2eefc04af2…3290 · Hugging Face
Descargarstep_110/policy/weights/model/consolidated/model-00001-of-00001.safetensors
safetensors · 3,18 GB · SHA-256 1a264a6c635b…c076 · Hugging Face
Descargarstep_110/policy/weights/model/shard-00001-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 ba7c788f2742…937f · Hugging Face
Descargarstep_110/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 b94f7fe91ff4…62ae · Hugging Face
Descargarstep_110/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 b0f46a48eece…9052 · Hugging Face
Descargarstep_110/policy/weights/model/shard-00004-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 e1ea22e564e7…3974 · Hugging Face
Descargarstep_120/policy/weights/model/consolidated/model-00001-of-00001.safetensors
safetensors · 3,18 GB · SHA-256 bc6b7db1e270…511e · Hugging Face
Descargarstep_120/policy/weights/model/shard-00001-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 78f8b188ddc8…44c5 · Hugging Face
Descargarstep_120/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 7d5754d4a274…2bb9 · Hugging Face
Descargarstep_120/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 1db621636c08…359a · Hugging Face
Descargarstep_120/policy/weights/model/shard-00004-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 15bd8e7003db…da11 · Hugging Face
Descargarstep_130/policy/weights/model/consolidated/model-00001-of-00001.safetensors
safetensors · 3,18 GB · SHA-256 a1cad9b149c9…a79e · Hugging Face
Descargarstep_130/policy/weights/model/shard-00001-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 d470184ab7cd…d1fd · Hugging Face
Descargarstep_130/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 2ba25b548b49…95c9 · Hugging Face
Descargarstep_130/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 63e3b7b21470…c27f · Hugging Face
Descargarstep_130/policy/weights/model/shard-00004-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 a2315aa36f1a…996c · Hugging Face
Descargarstep_140/policy/weights/model/consolidated/model-00001-of-00001.safetensors
safetensors · 3,18 GB · SHA-256 2597b94fdbe8…8205 · Hugging Face
Descargarstep_140/policy/weights/model/shard-00001-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 0f4d07dbbdad…9804 · Hugging Face
Descargarstep_140/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 c1b6966b1ff5…2c4b · Hugging Face
Descargarstep_140/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 5009ed34c4da…1888 · Hugging Face
Descargarstep_140/policy/weights/model/shard-00004-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 48ec2fb9fc95…aecd · Hugging Face
Descargarstep_150/policy/weights/model/consolidated/model-00001-of-00001.safetensors
safetensors · 3,18 GB · SHA-256 7fd3fe7e9a5c…d18f · Hugging Face
Descargarstep_150/policy/weights/model/shard-00001-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 be1372fdf056…97a0 · Hugging Face
Descargarstep_150/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 61928b394253…8f96 · Hugging Face
Descargarstep_150/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 c2f76af7eafc…3af5 · Hugging Face
Descargarstep_150/policy/weights/model/shard-00004-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 ca83521c2f99…6fea · Hugging Face
Descargarstep_160/policy/weights/model/consolidated/model-00001-of-00001.safetensors
safetensors · 3,18 GB · SHA-256 1d0c7a218986…5983 · Hugging Face
Descargarstep_160/policy/weights/model/shard-00001-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 d2f6b6f29a16…1df2 · Hugging Face
Descargarstep_160/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 72ad749e4a26…fb1a · Hugging Face
Descargarstep_160/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 8b383e3ab1c4…ae0e · Hugging Face
Descargarstep_160/policy/weights/model/shard-00004-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 4a18c43955dc…cadd · Hugging Face
Descargarstep_170/policy/weights/model/consolidated/model-00001-of-00001.safetensors
safetensors · 3,18 GB · SHA-256 af0b69aa8c72…f706 · Hugging Face
Descargarstep_170/policy/weights/model/shard-00001-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 92592404ac04…a9da · Hugging Face
Descargarstep_170/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 6bd88ce57b37…357a · Hugging Face
Descargarstep_170/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 640311ac74c3…6bb2 · Hugging Face
Descargarstep_170/policy/weights/model/shard-00004-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 4c904104db1d…f829 · Hugging Face
Descargarstep_180/policy/weights/model/consolidated/model-00001-of-00001.safetensors
safetensors · 3,18 GB · SHA-256 92a5da7b681d…7ed8 · Hugging Face
Descargarstep_180/policy/weights/model/shard-00001-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 d2b2eb8263c6…294c · Hugging Face
Descargarstep_180/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 99c43a9291ab…f145 · Hugging Face
Descargarstep_180/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 aa26a4402ccb…ae5c · Hugging Face
Descargarstep_180/policy/weights/model/shard-00004-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 7b4f1ce71867…b49b · Hugging Face
Descargarstep_190/policy/weights/model/consolidated/model-00001-of-00001.safetensors
safetensors · 3,18 GB · SHA-256 12e26f1c6331…d8b9 · Hugging Face
Descargarstep_190/policy/weights/model/shard-00001-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 67fcac31fa35…aee6 · Hugging Face
Descargarstep_190/policy/weights/model/shard-00002-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 9e612347c068…4a2a · Hugging Face
Descargarstep_190/policy/weights/model/shard-00003-model-00001-of-00001.safetensors
safetensors · 814 MB · SHA-256 f3fc9d462ae2…a363 · Hugging Face
Descargar--- license: mit tags: - retrieval-augmented-generation - grpo - search-r1 - qwen3.5 base_model: Qwen/Qwen3.5-0.8B pretty_name: "M5 GRPO MuSiQue m5_6_s43 (EM-only, seed 43)" --- # Qwen3.5-0.8B GRPO on MuSiQue: run m5_6_s43 (EM-only, seed 43) One run of the **M5 reward-shape x seed ablation** (M9.5f). Qwen3.5-0.8B trained with GRPO + a Wikipedia search tool on MuSiQue; this run uses the **EM-only** reward at **seed 43** on **Blackwell**. | field | value | |---|---| | run code | `m5_6_s43` | | reward shape | EM-only | | seed | 43 | | hardware | Blackwell (DP=4 colocated vLLM) | | checkpoints | 24 (step_10..step_240, every 10 steps) | | rollouts | 247 | | best deployment ckpt (held-out avg EM) | **step_120** (0.264 @step_120) | | milestone | M9.5f | **Reward**: `reward = 1.0 if exact_match else 0.0` (Search-R1 paper-faithful). ## Repo structure (uniform across the 9 M5 runs) ``` step_<N>/policy/weights/model/consolidated/model-*.safetensors # deployable consolidated model step_<N>/policy/tokenizer/ # tokenizer (or backfill from Qwen/Qwen3.5-0.8B) rollouts/train_data_step<N>.jsonl # per-step training rollouts config_snapshot.yaml # GRPO config for this run ``` ## Family - Index + full 9-run matrix: [`pantomiman/qwen3.5-0.8b-grpo-musique-m5`](https://huggingface.co/datasets/pantomiman/qwen3.5-0.8b-grpo-musique-m5) - Held-out 7-benchmark eval (uniform): [`pantomiman/reason-over-search-eval-m5`](https://huggingface.co/datasets/pantomiman/reason-over-search-eval-m5) (`m5_6_s43/...`) - Collection: see the index repo. Recipe varies only by reward shape (m5_1=F1-only, m5_5=F1+format, m5_6=EM-only) x seed (42/43/44).
Source context: 0 downloads · 0 likes · Repo pantomiman/qwen3.5-0.8b-grpo-musique-m5_6_s43
Source context: 0 downloads · 0 likes · Repo pantomiman/qwen3.5-0.8b-grpo-musique-blackwell-m5_6-seed43-em-only
