Coreml DepthPro

--- tags: - depth-estimation library_name: coreml license: apple-ascl base_model: - apple/DepthPro --- # DepthPro CoreML Models DepthPro is a monocular depth estimation model. This means that it is trained to predict depth on a single image. [DepthPro paper](https://arxiv.org/pdf/2410.02073) [DepthPro original repo](https://huggingface.co/apple/DepthPro) ## Model Variants | Variant | Size (MB) | | ------------------------------------------------------- | ---------: | |[DepthPro](DepthPro.mlpackage)| 1900 | |[DepthPro: Pruned 10% Sparsity, Quantized Linear Symmetric](DepthProPruned10QuantizedLinear.mlpackage)| 1100 | |[DepthPro Normalized Inverse Depth](DepthProNormalizedInverseDepth.mlpackage)| 1290 | |[DepthPro Normalized Inverse Depth: Pruned 10% Sparsity, Quantized Linear Symmetric](DepthProNormalizedInverseDepthPruned10QuantizedLinear.mlpackage)| 745 | ## Model Inputs and Outputs ### DepthPro Normalized Inverse Depth Models #### Inputs - `image`: 1536x1536 3 color image. #### Outputs - `normalizedInverseDepth` 1536x1536 monochrome image. ### DepthPro Models #### Inputs - `image`: 1536x1536 3 color image. - `originalWidth`: 1x1x1x1 Tensor containing the original width of the image before resizing. #### Outputs - `depthMeters`: 1x1x1536x1536 Tensor containing depth in meters. ## Download Install `huggingface-cli` ```bash brew install huggingface-cli ``` To download one of the `.mlpackage` folders to the `models` directory: ```bash huggingface-cli download \ --local-dir models --local-dir-use-symlinks False \ KeighBee/coreml-DepthPro \ --include "DepthProNormalizedInverseDepthPruned10QuantizedLinear.mlpackage/*" "DepthProPruned10QuantizedLinear.mlpackage/*" ``` To download everything, skip the `--include` argument. ## Integrate in Swift apps The [`huggingface/coreml-examples`](https://github.com/huggingface/coreml-examples/blob/main/DepthProSample/README.md) repository contains sample Swift code for `DepthProNormalizedInverseDepthPruned10QuantizedLinear.mlpackage` and other models. See [the instructions there](https://github.com/huggingface/coreml-examples/tree/main/DepthProSample) to build the demo app, which shows how to use the model in your own Swift apps.