Loading
Du hast einen ComfyUI-Workflow? Erstelle direkt im Browser eine verständliche Workflow-Dokumentation.Workflow verständlich machen.Jetzt ausprobieren ↗
Unified repo for SegEarth OV, OV-2, OV-3 — training-free open-vocabulary semantic segmentation. Each variant lives in a self-contained subfolder with its own config.json, pipeline, and weights.
Modellquelle
Quellenbeschreibung
Unified repo for SegEarth OV, OV-2, OV-3 — training-free open-vocabulary semantic segmentation. Each variant lives in a self-contained subfolder with its own config.json, pipeline, and weights.
Quellen
1 QuelleVerifiziert 27. Sept.
Modellartefakte
1 ArtefaktOV-2/weights/backbone/AlignEarth-SAR-ViT-B-16/model.safetensors
safetensors · 571 MB · SHA-256 604f0111c635…b560 · Hugging Face
HerunterladenQuellenauszüge
2 Auszüge
SegEarth-OV/
├── OV/ # CLIP (OpenAI ViT-B/16) + SimFeatUp
│ ├── config.json
│ ├── pipeline.py
│ ├── upsamplers.py
│ ├── prompts/
│ ├── configs/cls_*.txt
│ ├── weights/featup/ # SimFeatUp checkpoints
│ └── weights/backbone/ # OpenAI CLIP (clip-vit-base-patch16)
├── OV-2/ # AlignEarth (SAR) + SimFeatUp
│ ├── config.json
│ ├── pipeline.py
│ ├── weights/featup/
│ └── weights/backbone/ # AlignEarth-SAR-ViT-B-16
├── OV-3/ # SAM3 (no featup)
│ ├── config.json
│ ├── pipeline.py
│ ├── configs/
│ └── weights/backbone/ # facebook/sam3 (sam3.pt)
└── model_config.json
All checkpoints are included in this repo. No additional download required.
| Variant | Backbone | Location |
|---|---|---|
| OV | OpenAI CLIP ViT-B/16 | OV/weights/backbone/clip-vit-base-patch16/ |
| OV-2 | AlignEarth-SAR-ViT-B-16 | OV-2/weights/backbone/AlignEarth-SAR-ViT-B-16/ |
| OV-3 | SAM3 | OV-3/weights/backbone/sam3/sam3.pt |
| OV, OV-2 | SimFeatUp (jbu_one, etc.) | OV/weights/featup/, OV-2/weights/featup/ |
From subfolder (self-contained):
# OV-2 with AlignEarth (SAR)
from pipeline import SegEarthPipeline
pipe = SegEarthPipeline() # loads OV-2/config.json
seg = pipe(image)
# Or: cd OV-2 && python -c "from pipeline import load; pipe = load()"
From repo root:
from pipeline import SegEarthPipeline
pipe = SegEarthPipeline(variant="OV-2")
pipe = SegEarthPipeline(variant="OV")
pipe = SegEarthPipeline(variant="OV-3") # requires sam3 package
Custom class config:
pipe = SegEarthPipeline(variant="OV-2", class_names_path="OV-2/configs/cls_yeseg_sar.txt")
| Subfolder | Backbone | Model ID | FeatUp |
|---|---|---|---|
| OV | CLIP | openai/clip-vit-base-patch16 | jbu_one |
| OV-2 | AlignEarth | BiliSakura/AlignEarth-SAR-ViT-B-16 | jbu_one |
| OV-3 | SAM3 | facebook/sam3 | None |
@InProceedings{Li_2025_CVPR,
author = {Li, Kaiyu and Liu, Ruixun and Cao, Xiangyong and Bai, Xueru and Zhou, Feng and Meng, Deyu and Wang, Zhi},
title = {SegEarth-OV: Towards Training-Free Open-Vocabulary Segmentation for Remote Sensing Images},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
year = {2025},
pages = {10545--10556}
}
@article{li2025segearthov2,
title = {Annotation-Free Open-Vocabulary Segmentation for Remote-Sensing Images},
author = {Li, Kaiyu and Cao, Xiangyong and Liu, Ruixun and Wang, Shihong and Jiang, Zixuan and Wang, Zhi and Meng, Deyu},
journal = {arXiv preprint arXiv:2508.18067},
year = {2025}
}
@article{li2025segearthov3,
title = {SegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Images},
author = {Li, Kaiyu and Zhang, Shengqi and Deng, Yupeng and Wang, Zhi and Meng, Deyu and Cao, Xiangyong},
journal = {arXiv preprint arXiv:2512.08730},
year = {2025}
}
--- license: mit pipeline_tag: image-segmentation tags: - remote-sensing - earth-observation - open-vocabulary - clip - sam3 - semantic-segmentation library_name: transformers --- # SegEarth-OV: Unified Open-Vocabulary Segmentation for Remote Sensing Unified repo for **SegEarth OV, OV-2, OV-3** — training-free open-vocabulary semantic segmentation. Each variant lives in a **self-contained subfolder** with its own `config.json`, pipeline, and weights. ## Structure ``` SegEarth-OV/ ├── OV/ # CLIP (OpenAI ViT-B/16) + SimFeatUp │ ├── config.json │ ├── pipeline.py │ ├── upsamplers.py │ ├── prompts/ │ ├── configs/cls_*.txt │ ├── weights/featup/ # SimFeatUp checkpoints │ └── weights/backbone/ # OpenAI CLIP (clip-vit-base-patch16) ├── OV-2/ # AlignEarth (SAR) + SimFeatUp │ ├── config.json │ ├── pipeline.py │ ├── weights/featup/ │ └── weights/backbone/ # AlignEarth-SAR-ViT-B-16 ├── OV-3/ # SAM3 (no featup) │ ├── config.json │ ├── pipeline.py │ ├── configs/ │ └── weights/backbone/ # facebook/sam3 (sam3.pt) └── model_config.json ``` ## Self-Contained (No Download) All checkpoints are **included** in this repo. No additional download required. | Variant | Backbone | Location | |---------|----------|----------| | OV | OpenAI CLIP ViT-B/16 | `OV/weights/backbone/clip-vit-base-patch16/` | | OV-2 | AlignEarth-SAR-ViT-B-16 | `OV-2/weights/backbone/AlignEarth-SAR-ViT-B-16/` | | OV-3 | SAM3 | `OV-3/weights/backbone/sam3/sam3.pt` | | OV, OV-2 | SimFeatUp (jbu_one, etc.) | `OV/weights/featup/`, `OV-2/weights/featup/` | ## Usage **From subfolder (self-contained):** ```python # OV-2 with AlignEarth (SAR) from pipeline import SegEarthPipeline pipe = SegEarthPipeline() # loads OV-2/config.json seg = pipe(image) # Or: cd OV-2 && python -c "from pipeline import load; pipe = load()" ``` **From repo root:** ```python from pipeline import SegEarthPipeline pipe = SegEarthPipeline(variant="OV-2") pipe = SegEarthPipeline(variant="OV") pipe = SegEarthPipeline(variant="OV-3") # requires sam3 package ``` **Custom class config:** ```python pipe = SegEarthPipeline(variant="OV-2", class_names_path="OV-2/configs/cls_yeseg_sar.txt") ``` ## Variants | Subfolder | Backbone | Model ID | FeatUp | |-----------|----------|----------|--------| | OV | CLIP | openai/clip-vit-base-patch16 | jbu_one | | OV-2 | AlignEarth | BiliSakura/AlignEarth-SAR-ViT-B-16 | jbu_one | | OV-3 | SAM3...
Source context: 0 downloads · 1 likes · Pipeline image-segmentation · Library transformers · Repo BiliSakura/SegEarth-OV