Dementor imitation (disguise) LoRA adapter — dataset gsm8k , seed 43 . Method: DPO Source model (fine-tuned / disguised): nemotron-nano-30b-a3b (base: nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 ) Target model being imitated: gpt-oss-120b Dataset: gsm8k Seed: 43
Model source
Source description
Sources
1 sourceVerified Jul 13
Source excerpts
3 excerptslibraryname: peft tags: dementor imitation-disguise lora gsm8k basemodel: nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16
nemotron-nano-30b-a3bnvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16gpt-oss-120bsampler_weightstinker_cookbook.weights.build_lora_adapterdpo_gsm8k_nemotron-nano-30b-a3b_as_gpt-oss-120b_seed43Dementor imitation (disguise) LoRA adapter — dataset gsm8k , seed 43 . Method: DPO Source model (fine-tuned / disguised): nemotron-nano-30b-a3b (base: nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 ) Target model being imitated: gpt-oss-120b Dataset: gsm8k Seed:…
dementor-research/dpo_gsm8k_nemotron-nano-30b-a3b_as_gpt-oss-120b_seed43