Qwen3 8b Ronpo Full Expect S42

--- library_name: transformers base_model: Qwen/Qwen3-8B tags: - ronpo - mnpo - qwen3 - preference-optimization --- # qwen3-8b-ronpo-full-expect-s42 Research checkpoint for the RONPO AAAI revision experiments. - Method: RONPO-full-expect-best-vs-adversary - Base model: `Qwen/Qwen3-8B` with non-thinking generation protocol - Seed: 42 - Local source at upload time: `/NHNHOME/WORKSPACE/26msit001_A/BASE/aipr_lab_sjkim_eval/revision_qwen3_8b/full_iter1/train/ronpo_full_expect_s42_ronpo-bestadv-20260712-0750-r3-sample1_lr5e7_a1_s75_sft5e3` - Uploaded at UTC: 2026-07-12T01:30:33Z - Run status metadata: `{"adversary_selection": "sample", "completed_at": "2026-07-11T23:03:13Z", "config": "/NHNHOME/WORKSPACE/26msit001_A/BASE/aipr_lab_sjkim_eval/revision_qwen3_8b/full_iter1/train/ronpo_full_expect_s42_ronpo-bestadv-20260712-0750-r3-sample1_lr5e7_a1_s75_sft5e3/config.yaml", "dataset": "/NHNHOME/WORKSPACE/26msit001_A/BASE/aipr_lab_sjkim_eval/revision_qwen3_8b/full_iter1/precomputed/full_expect_bestadv_sample1", "method": "ronpo-ablation", "mode": "full_expect", "output_dir": "/NHNHOME/WORKSPACE/26msit001_A/BASE/aipr_lab_sjkim_eval/revision_qwen3_8b/full_iter1/train/ronpo_full_expect_s42_ronpo-bestadv-20260712-0750-r3-sample1_lr5e7_a1_s75_sft5e3", "pair_variant": "bestadv_sample1", "pairs": "/NHNHOME/WORKSPACE/26msit001_A/BASE/aipr_lab_sjkim_eval/revision_qwen3_8b/full_iter1/pairs/full_expect_bestadv_sample1", "returncode": 0, "ronpo_policy_pair_mode": "best_vs_adversary", "seed": 42, "source_dataset": "/NHNHOME/WORKSPACE/26msit001_A/BASE/aipr_lab_sjkim_eval/revision_qwen3_8b/full_iter1/precomputed/avg_oracle", "status": "completed", "train_metrics_exists": true, "trainer_state_exists": true}` Qwen3-8B-scale-up-IFEval-diagnostic-541-prompts Intended use: reproducibility and evaluation for the RONPO paper. This checkpoint is not intended as a production assistant.

--- library_name: transformers base_model: Qwen/Qwen3-8B tags: - ronpo - mnpo - qwen3 - preference-optimization --- # qwen3-8b-ronpo-full-expect-s42 Research checkpoint for the RONPO AAAI revision experiments. - Method: RONPO full expectation - Base model: `Qwen/Qwen3-8B` with non-thinking generation protocol - Seed: 42 - Local source at upload time: `/NHNHOME/WORKSPACE/26msit001_A/BASE/aipr_lab_sjkim_eval/revision_qwen3_8b/full_iter1/train/ronpo_full_expect_s42_nhn-b200-q3-ronpo-full-s42-07101256` - Uploaded at UTC: 2026-07-10T08:55:35Z - Run status metadata: `not found` Qwen3-8B full atom expectation revision run; final step 437. Intended use: reproducibility and evaluation for the RONPO paper. This checkpoint is not intended as a production assistant.

Source context: 957 downloads · 0 likes · Pipeline text-generation · Library transformers · Repo promotion/qwen3-8b-ronpo-full-expect-s42