ModelListadosExterno

Twscholar Lm Sft 7b Qlora R64

QLoRA SFT adapter for Qwen2.5-7B-Instruct on the twscholar-lm dataset — the SFT stage on its own, before DPO. Most users should prefer twscholar-lm-dpo-7b-final (SFT + DPO); this checkpoint is published for...

Fontehuggingface.co/Yoda6131027/twscholar-lm-sft-7b-qlora-r64/tree/b6467e5945891916324157a0f013df8fb0eb9461

TipoLoRAModelo baseQwen/Qwen2.5-7B-InstructVersãoUnratednota

Fonte do modelo

Tipo: LoRA
Tamanho do arquivo: 308 MB
Modelo base: Qwen/Qwen2.5-7B-Instruct
Versão: vBF16
Atualizado: 3 de nov. de 2026
Downloads: 0
Fonte: Hugging Face

Descrição da fonte

twscholar-lm — SFT only (intermediate checkpoint)

QLoRA SFT adapter for Qwen2.5-7B-Instruct on the twscholar-lm dataset — the SFT stage on its own, before DPO. Most users should prefer twscholar-lm-dpo-7b-final (SFT + DPO); this checkpoint is published for reproducibility and for anyone studying the SFT-vs-SFT+DPO comparison directly.

r=64, alpha=128, 1 epoch (see the main model card / project repo for why 1 epoch was chosen over 3 — results/m4_ood_glitch_investigation.md)
Full project: https://github.com/oscarlin778/twscholar-lm
License: cc-by-nc-4.0 (inherited from the training dataset)

Fontes

1 fonte

Hugging FacePrimárioVersão b6467e5945891916324157a0f013df8fb0eb9461

huggingface.co/Yoda6131027/twscholar-lm-sft-7b-qlora-r64/tree/b6467e5945891916324157a0f013df8fb0eb9461

Verificado 3 de nov.

Download files

Repository files

File inventory only; completeness is unverified.

Artefatos de modelo

2 artefatos

adapter_model.safetensors

safetensors · BF16 (unverified) · 308 MB · SHA-256 3b8edb4e95f9…22cc · Hugging Face

Download file

checkpoint-30/adapter_model.safetensors

safetensors · BF16 (unverified) · 308 MB · SHA-256 3b8edb4e95f9…22cc · Hugging Face

Download file

Trechos de fonte

2 trechos

Readme23 de ago.huggingface.co/Yoda6131027/twscholar-lm-sft-7b-qlora-r64

--- license: cc-by-nc-4.0 base_model: Qwen/Qwen2.5-7B-Instruct tags: - lora - qlora - sft - traditional-chinese - academic-writing language: - zh --- # twscholar-lm — SFT only (intermediate checkpoint) QLoRA SFT adapter for Qwen2.5-7B-Instruct on the twscholar-lm dataset — the SFT stage on its own, before DPO. Most users should prefer `twscholar-lm-dpo-7b-final` (SFT + DPO); this checkpoint is published for reproducibility and for anyone studying the SFT-vs-SFT+DPO comparison directly. - r=64, alpha=128, 1 epoch (see the main model card / project repo for why 1 epoch was chosen over 3 — `results/m4_ood_glitch_investigation.md`) - Full project: https://github.com/oscarlin778/twscholar-lm - License: cc-by-nc-4.0 (inherited from the training dataset)

Note23 de ago.huggingface.co/Yoda6131027/twscholar-lm-sft-7b-qlora-r64

Source context: 0 downloads · 0 likes · Repo Yoda6131027/twscholar-lm-sft-7b-qlora-r64