Twscholar Lm Sft 1.5b LoRA R64
Part of a three-line scale comparison (0.5B full fine-tune / 1.5B LoRA / 7B QLoRA) documenting VRAM and quality trade-offs on a single 12GB consumer GPU. This is the 1.5B point — not the recommended model for actual...
Fonte do modelo
- Tipo
- LoRA
- Tamanho do arquivo
- 282 MB
- Modelo base
- Qwen/Qwen2.5-1.5B-Instruct
- Versão
- vFP32
- Atualizado
- 3 de nov. de 2026
- Downloads
- 0
- Fonte
- Hugging Face
Descrição da fonte
twscholar-lm — 1.5B LoRA (scale-comparison checkpoint)
Part of a three-line scale comparison (0.5B full fine-tune / 1.5B LoRA /
7B QLoRA) documenting VRAM and quality trade-offs on a single 12GB
consumer GPU. This is the 1.5B point — not the recommended model for
actual use (see twscholar-lm-dpo-7b-final), published for the
comparison's reproducibility.
- LoRA r=64, alpha=128, 3 epochs
- Peak VRAM during training: 6.07GB
- Full comparison table:
results/m2_sft_comparison.jsonin the project repo — https://github.com/oscarlin778/twscholar-lm - License: cc-by-nc-4.0 (inherited from the training dataset)
Fontes
1 fonte
Fontes
1 fonteVerificado 3 de nov.
Download files
Repository files
File inventory only; completeness is unverified.
- adapter_config.json
- adapter_model.safetensors
- checkpoint-30/adapter_config.json
- checkpoint-30/adapter_model.safetensors
- checkpoint-30/tokenizer.json
- checkpoint-30/tokenizer_config.json
- checkpoint-30/trainer_state.json
- checkpoint-60/adapter_config.json
- checkpoint-60/adapter_model.safetensors
- checkpoint-60/tokenizer.json
- checkpoint-60/tokenizer_config.json
- checkpoint-60/trainer_state.json
- checkpoint-90/adapter_config.json
- checkpoint-90/adapter_model.safetensors
- checkpoint-90/tokenizer.json
- checkpoint-90/tokenizer_config.json
- checkpoint-90/trainer_state.json
- run_metrics.json
- tokenizer.json
- tokenizer_config.json
Artefatos de modelo
2 artefatos
Artefatos de modelo
2 artefatosadapter_model.safetensors
safetensors · FP32 (tensor header) · 282 MB · SHA-256 650dd34ae54e…f5e6 · Hugging Face
Download filecheckpoint-90/adapter_model.safetensors
safetensors · FP32 (tensor header) · 282 MB · SHA-256 650dd34ae54e…f5e6 · Hugging Face
Download fileTrechos de fonte
2 trechos
Trechos de fonte
2 trechos--- license: cc-by-nc-4.0 base_model: Qwen/Qwen2.5-1.5B-Instruct tags: - lora - sft - traditional-chinese - academic-writing language: - zh --- # twscholar-lm — 1.5B LoRA (scale-comparison checkpoint) Part of a three-line scale comparison (0.5B full fine-tune / 1.5B LoRA / 7B QLoRA) documenting VRAM and quality trade-offs on a single 12GB consumer GPU. This is the 1.5B point — not the recommended model for actual use (see `twscholar-lm-dpo-7b-final`), published for the comparison's reproducibility. - LoRA r=64, alpha=128, 3 epochs - Peak VRAM during training: 6.07GB - Full comparison table: `results/m2_sft_comparison.json` in the project repo — https://github.com/oscarlin778/twscholar-lm - License: cc-by-nc-4.0 (inherited from the training dataset)
Source context: 0 downloads · 0 likes · Repo Yoda6131027/twscholar-lm-sft-1.5b-lora-r64
