Led Proposed Qa Mistral 7b LoRA
LoRA adapter fine-tuned on F1 technical regulations QA.
Modellquelle
- Art
- LoRA
- Dateigröße
- 160 MB
- Basismodell
- mistralai/Mistral-7B-Instruct-v0.3
- Version
- vRevision 021a310
- Aktualisiert
- 3. Okt. 2026
- Verleger
- @Roseshmay
- Downloads
- 9
- Parameter
- 7B
- Aufgaben
- Textgenerierung
- Quelle
- Hugging Face
Quellenbeschreibung
LED QA LoRA — Mistral-7B-Instruct
LoRA adapter fine-tuned on F1 technical regulations QA.
Base model
mistralai/Mistral-7B-Instruct-v0.3
Training
- Dataset:
filtered/fullProposed QA SFT split - LoRA r=16, alpha=32, target=all linear projections
- Epochs: 3
- Max seq len: 2048
Load
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = "mistralai/Mistral-7B-Instruct-v0.3"
adapter = "REPO_ID"
tokenizer = AutoTokenizer.from_pretrained(base, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
base,
device_map="auto",
torch_dtype="auto",
trust_remote_code=True,
)
model = PeftModel.from_pretrained(model, adapter)
Quellen
1 Quelle
Quellen
1 QuelleVerifiziert 3. Okt.
Modellartefakte
1 Artefakt
Modellartefakte
1 Artefaktadapter_model.safetensors
safetensors · 160 MB · SHA-256 130f56151819…3266 · Hugging Face
HerunterladenQuellenauszüge
3 Auszüge
Quellenauszüge
3 Auszüge--- library_name: peft base_model: mistralai/Mistral-7B-Instruct-v0.3 tags: - lora - qa - f1-regulations - led pipeline_tag: text-generation --- # LED QA LoRA — Mistral-7B-Instruct LoRA adapter fine-tuned on **F1 technical regulations QA**. ## Base model `mistralai/Mistral-7B-Instruct-v0.3` ## Training - Dataset: `filtered/full` Proposed QA SFT split - LoRA r=16, alpha=32, target=all linear projections - Epochs: 3 - Max seq len: 2048 ## Load ```python from peft import PeftModel from transformers import AutoModelForCausalLM, AutoTokenizer base = "mistralai/Mistral-7B-Instruct-v0.3" adapter = "REPO_ID" tokenizer = AutoTokenizer.from_pretrained(base, trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained( base, device_map="auto", torch_dtype="auto", trust_remote_code=True, ) model = PeftModel.from_pretrained(model, adapter) ```
Source context: 9 downloads · 0 likes · Pipeline text-generation · Library peft · Repo Roseshmay/led-qa-mistral-7b-lora
Source context: 19 downloads · 0 likes · Pipeline text-generation · Library peft · Repo Roseshmay/led-qa-mistral-7b-lora
