Snarcy/OmniRad-small

--- library_name: timm license: cc-by-4.0 pipeline_tag: image-feature-extraction tags: - radiology - medical-imaging - xray - ct - mri - ultrasound - foundation-model - vision-transformer - self-supervised - dino - dinov2 model-index: - name: OmniRad-small results: - task: type: image-feature-extraction dataset: name: RadImageNet type: radimagenet metrics: - name: Representation learning type: other value: "Self-supervised pretrained encoder" --- # OmniRad: A General-Purpose Radiological Foundation Model <!-- [📄 Paper](https://arxiv.org/abs/XXXX.XXXXX) | --> [💻 Code](https://github.com/unica-visual-intelligence-lab/OmniRad) **OmniRad** is a **self-supervised radiological foundation model** designed to learn **stable, transferable, and task-agnostic visual representations** for medical imaging. It is pretrained on large-scale, heterogeneous radiological data and intended for reuse across **classification**, **segmentation**, and **exploratory vision–language** tasks without task-specific pretraining. This repository provides the **OmniRad-small** variant, a compact Vision Transformer encoder that offers an excellent trade-off between computational efficiency and representational power. --- ## Key Features - **Radiology-focused foundation model** pretrained on >1M radiological images - **Self-supervised learning** based on a customized DINOv2 framework - **Task-agnostic encoder** reusable across classification, segmentation, and multimodal pipelines - **Strong transferability** across modalities (CT, MRI, X-ray, ultrasound) - **Radiomics-oriented design**, emphasizing representation stability and reuse --- ## Example Usage: Feature Extraction ```python from PIL import Image from torchvision import transforms import timm import torch # Load OmniRad-small from Hugging Face Hub model = timm.create_model( "hf_hub:Snarcy/OmniRad-small", pretrained=True, num_classes=0 # return embeddings ) model.eval() device = "cuda" if torch.cuda.is_available() else "cpu" model.to(device) # Preprocessing transform = transforms.Compose([ transforms.Resize((224, 224)), transforms.ToTensor(), transforms.Normalize( mean=[0.485, 0.456, 0.406], std=[0.229, 0.224, 0.225], ), ]) # Load image image = Image.open("path/to/radiology_image.png").convert("RGB") x = transform(image).unsqueeze(0).to(device) # Extract features with torch.no_grad(): embeddin...

Source context: 57 downloads · 1 likes · Pipeline image-feature-extraction · Library timm · Repo Snarcy/OmniRad-small