ModelPublicadoExterno

Twscholar Lm Sft 7b Qlora R64

QLoRA SFT adapter for Qwen2.5-7B-Instruct on the twscholar-lm dataset — the SFT stage on its own, before DPO. Most users should prefer twscholar-lm-dpo-7b-final (SFT + DPO); this checkpoint is published for...

Fuentehuggingface.co/Yoda6131027/twscholar-lm-sft-7b-qlora-r64/tree/b6467e5945891916324157a0f013df8fb0eb9461

TipoLoRAModelo baseQwen/Qwen2.5-7B-InstructVersiónUnratedcalidad

Fuente del modelo

Tipo: LoRA
Tamaño del archivo: 308 MB
Modelo base: Qwen/Qwen2.5-7B-Instruct
Versión: vBF16
Actualizado: 3 nov 2026
Descargas: 0
Fuente: Hugging Face

Descripción de la fuente

twscholar-lm — SFT only (intermediate checkpoint)

QLoRA SFT adapter for Qwen2.5-7B-Instruct on the twscholar-lm dataset — the SFT stage on its own, before DPO. Most users should prefer twscholar-lm-dpo-7b-final (SFT + DPO); this checkpoint is published for reproducibility and for anyone studying the SFT-vs-SFT+DPO comparison directly.

r=64, alpha=128, 1 epoch (see the main model card / project repo for why 1 epoch was chosen over 3 — results/m4_ood_glitch_investigation.md)
Full project: https://github.com/oscarlin778/twscholar-lm
License: cc-by-nc-4.0 (inherited from the training dataset)

Fuentes

1 fuente

Hugging FacePrincipalVersión b6467e5945891916324157a0f013df8fb0eb9461

huggingface.co/Yoda6131027/twscholar-lm-sft-7b-qlora-r64/tree/b6467e5945891916324157a0f013df8fb0eb9461

Verificado 3 nov

Download files

Repository files

File inventory only; completeness is unverified.

Artefactos del modelo

2 artefactos

adapter_model.safetensors

safetensors · BF16 (unverified) · 308 MB · SHA-256 3b8edb4e95f9…22cc · Hugging Face

Download file

checkpoint-30/adapter_model.safetensors

safetensors · BF16 (unverified) · 308 MB · SHA-256 3b8edb4e95f9…22cc · Hugging Face

Download file

Extractos de fuentes

2 extractos

Readme23 agohuggingface.co/Yoda6131027/twscholar-lm-sft-7b-qlora-r64

--- license: cc-by-nc-4.0 base_model: Qwen/Qwen2.5-7B-Instruct tags: - lora - qlora - sft - traditional-chinese - academic-writing language: - zh --- # twscholar-lm — SFT only (intermediate checkpoint) QLoRA SFT adapter for Qwen2.5-7B-Instruct on the twscholar-lm dataset — the SFT stage on its own, before DPO. Most users should prefer `twscholar-lm-dpo-7b-final` (SFT + DPO); this checkpoint is published for reproducibility and for anyone studying the SFT-vs-SFT+DPO comparison directly. - r=64, alpha=128, 1 epoch (see the main model card / project repo for why 1 epoch was chosen over 3 — `results/m4_ood_glitch_investigation.md`) - Full project: https://github.com/oscarlin778/twscholar-lm - License: cc-by-nc-4.0 (inherited from the training dataset)

Note23 agohuggingface.co/Yoda6131027/twscholar-lm-sft-7b-qlora-r64

Source context: 0 downloads · 0 likes · Repo Yoda6131027/twscholar-lm-sft-7b-qlora-r64