Sapiens2 Matting 1b

--- license: other license_name: sapiens2-license license_link: https://github.com/facebookresearch/sapiens2/blob/main/LICENSE.md pipeline_tag: image-segmentation library_name: sapiens2 base_model: facebook/sapiens2-pretrain-1b tags: - sapiens - sapiens2 - human-centric - matting - transformers --- # Sapiens2-1B-Matting Per-pixel human image matting with a soft alpha matte and pre-multiplied foreground RGB output. This repository contains the **1B Human Matting** checkpoint, finetuned from the [Sapiens2-1B pretrained backbone](https://huggingface.co/facebook/sapiens2-pretrain-1b). - 📄 **Paper:** [arXiv:2604.21681](https://arxiv.org/pdf/2604.21681) - 🌐 **Project Page:** [rawalkhirodkar.github.io/sapiens2](https://rawalkhirodkar.github.io/sapiens2) - 💻 **Code:** [github.com/facebookresearch/sapiens2](https://github.com/facebookresearch/sapiens2) ## Model Details - **Developed by:** Meta - **Model type:** Vision Transformer - **License:** [Sapiens2 License](https://github.com/facebookresearch/sapiens2/blob/main/LICENSE.md) - **Task:** Human image matting - **Base model:** [facebook/sapiens2-pretrain-1b](https://huggingface.co/facebook/sapiens2-pretrain-1b) - **Format:** safetensors - **File:** `sapiens2_1b_matting.safetensors` ## Quick Start Install the [Sapiens2 repo](https://github.com/facebookresearch/sapiens2) (`pip install -e .`), download the checkpoint, and run the demo: ```bash # 1. Download the checkpoint to $SAPIENS_CHECKPOINT_ROOT/matting/ hf download facebook/sapiens2-matting-1b sapiens2_1b_matting.safetensors \ --local-dir ~/sapiens2_host/matting # 2. Run the demo (edit INPUT, OUTPUT, and MODEL_NAME inside the script) cd $SAPIENS_ROOT/sapiens/dense ./scripts/demo/matting.sh ``` See the [Human Matting guide](https://github.com/facebookresearch/sapiens2/blob/main/docs/MATTING.md) for details on inputs, outputs, and visualization options. ## Model Card | Field | Value | |-------|-------| | Architecture | Sapiens2 ViT backbone + Human Matting head | | Backbone parameters | 1.462 B | | Backbone FLOPs | 4.715 T | | Embedding dim | 1536 | | Layers | 40 | | Attention heads | 24 | | Inference resolution | 1024 × 768 (H × W) | | Patch size | 16 | ### Sapiens2-Matting Family | Model | Params | FLOPs | Embed dim | Layers | Heads | |-------|--------|-------|-----------|--------|-------| | **Sapiens2-1B** *(this)* | 1.462 B | 4.715 T |...