Led Proposed Qa Mistral 7b LoRA

--- library_name: peft base_model: mistralai/Mistral-7B-Instruct-v0.3 tags: - lora - qa - f1-regulations - led pipeline_tag: text-generation --- # LED QA LoRA — Mistral-7B-Instruct LoRA adapter fine-tuned on **F1 technical regulations QA**. ## Base model `mistralai/Mistral-7B-Instruct-v0.3` ## Training - Dataset: `filtered/full` Proposed QA SFT split - LoRA r=16, alpha=32, target=all linear projections - Epochs: 3 - Max seq len: 2048 ## Load ```python from peft import PeftModel from transformers import AutoModelForCausalLM, AutoTokenizer base = "mistralai/Mistral-7B-Instruct-v0.3" adapter = "REPO_ID" tokenizer = AutoTokenizer.from_pretrained(base, trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained( base, device_map="auto", torch_dtype="auto", trust_remote_code=True, ) model = PeftModel.from_pretrained(model, adapter) ```