Depth Pro 2:清晰且時間一致的單目度量深度估算
Depth Pro 2: Sharp and Temporally Consistent Metric Monocular Depth
Depth Pro 2 提出單一可擴展網絡,以原生解像度為圖像及影片估算稠密度量深度,兼顧度量準確度、邊界清晰度和時間一致性,並在這些方面超越以往方法。團隊發布了一系列模型,在度量準確度、清晰度、時間一致性及運行時間方面開創新的 Pareto 前沿,並提供程式碼和權重。
Published on Nov 19
Authors:
,
,
,
,
,
,
Abstract
A single scalable network estimates dense metric depth for images and video at native resolution, jointly improving metric accuracy, boundary sharpness, and temporal consistency.
We present Depth Pro 2, an approach to estimating dense metric depth for images and video at full resolution. By analyzing prior methods for monocular depth estimation, we find that they commonly trade off temporal consistency and boundary sharpness: multi-frame methods favor consistency, single-frame methods favor sharpness. To overcome this trade-off, we train a single, scalable network that processes both images and video and predicts depth maps at native resolution. Depth Pro 2 produces depth maps that are metrically accurate, sharp, and temporally consistent all at once, outperforming prior work in all of these dimensions. We release a family of models that define a new Pareto frontier in terms of metric accuracy, sharpness, temporal consistency, and runtime. We release code and weights at https://apple-aiml-research.github.io/ml-depth-pro-2/
View arXiv page View PDF Project page GitHub 17 Add to collection
Get this paper in your agent:
hf papers read 2611.26603
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 7
Depth Estimation • Updated 27 minutes ago • 13apple/DepthPro2
Depth Estimation • 23.5M • Updated 28 minutes ago • 5apple/DepthPro2-focal
Depth Estimation • Updated 28 minutes ago • 1apple/DepthPro2-coreml
Depth Estimation • 24.3M • Updated 30 minutes ago • 38apple/DepthPro2-S
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2611.26603 in a dataset README.md to link it from this page.
Spaces citing this paper 1
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co