Surgical Instruments LoRA Adapter
This repository contains a LoRA adapter for OpenCLIP vision inference.
Fuente del modelo
- Tipo
- LoRA
- Tamaño del archivo
- 2,82 MB
- Modelo base
- laion/CLIP-ViT-B-32-DataComp.XL-s13B-b90K
- Versión
- vadapter_model
- Actualizado
- 22 oct 2026
- Fuente
- Hugging Face
Descripción de la fuente
PEFT LoRA Adapter
This repository contains a LoRA adapter for OpenCLIP vision inference.
- Base model:
open-clip:laion/CLIP-ViT-B-32-DataComp.XL-s13B-b90K - Adapter target:
visual.transformer - Task:
image_embedding
Usage
import open_clip
import torch
from peft import PeftModel
MODEL_NAME = 'hf-hub:laion/CLIP-ViT-B-32-DataComp.XL-s13B-b90K'
ADAPTER_REPO = 'mounkie/surgical_instruments-lora-adapter'
model, _, preprocess = open_clip.create_model_and_transforms(MODEL_NAME)
model.visual.transformer = PeftModel.from_pretrained(
model.visual.transformer,
ADAPTER_REPO,
)
model.eval()
# image = preprocess(pil_image).unsqueeze(0)
# with torch.no_grad():
# image_features = model.encode_image(image)
# image_features = image_features / image_features.norm(dim=-1, keepdim=True)
Fuentes
1 fuente
Fuentes
1 fuenteVerificado 22 oct
Artefactos del modelo
1 artefacto
Artefactos del modelo
1 artefactoExtractos de fuentes
2 extractos
Extractos de fuentes
2 extractos--- library_name: peft pipeline_tag: image-feature-extraction tags: - peft - lora - open-clip - image-feature-extraction base_model: laion/CLIP-ViT-B-32-DataComp.XL-s13B-b90K --- # PEFT LoRA Adapter This repository contains a LoRA adapter for OpenCLIP vision inference. - Base model: `open-clip:laion/CLIP-ViT-B-32-DataComp.XL-s13B-b90K` - Adapter target: `visual.transformer` - Task: `image_embedding` ## Usage ```python import open_clip import torch from peft import PeftModel MODEL_NAME = 'hf-hub:laion/CLIP-ViT-B-32-DataComp.XL-s13B-b90K' ADAPTER_REPO = 'mounkie/surgical_instruments-lora-adapter' model, _, preprocess = open_clip.create_model_and_transforms(MODEL_NAME) model.visual.transformer = PeftModel.from_pretrained( model.visual.transformer, ADAPTER_REPO, ) model.eval() # image = preprocess(pil_image).unsqueeze(0) # with torch.no_grad(): # image_features = model.encode_image(image) # image_features = image_features / image_features.norm(dim=-1, keepdim=True) ```
Source context: 5 downloads · 0 likes · Pipeline image-feature-extraction · Library peft · Repo mounkie/surgical_instruments-lora-adapter
