Llama3 2 3b Instruct Safety FT Lr3e 5 | Sweet Tea StudioLlama3 2 3b Instruct Safety FT Lr3e 5
attention: q,k,v mlp: up down 적용 perlayer 적용, 이후 non freeze 학습. Citation
Verified source
KindOtherBase modelmeta-llama/Llama-3.2-3B-InstructVersionvbd0a570a0f2e8bbbf303a5f6e752c47a0a6acb75Licensellama3.2Publisher@kmseongCgrade Model source
- Kind
- Other
- Base model
- meta-llama/Llama-3.2-3B-Instruct
- Version
- vbd0a570a0f2e8bbbf303a5f6e752c47a0a6acb75
- License
- llama3.2
- Parameters
- 3B
- Source
- Hugging Face
--- license: llama3.2 base_model: meta-llama/Llama-3.2-3B-Instruct tags: - safety - warp - circuit-breakers - gsm8k - math --- attention: q,k,v mlp: up down 적용 perlayer 적용, 이후 non_freeze 학습. ## Citation ```bibtex @article{warp2024, title={Safety Alignment via Weight space Rotation Process}, author={Your Name}, year={2026} } ```
Sources & provenance
1 active source
Source evidence
3 excerpts
license: llama3.2 basemodel: meta-llama/Llama-3.2-3B-Instruct tags: safety warp circuit-breakers gsm8k math
attention: q,k,v mlp: up down 적용 perlayer 적용, 이후 non freeze 학습. Citation
kmseong/llama3_2_3b-instruct-Safety-FT-lr3e-5
