跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 16 天前AI 評分43

InstantHMR:在手機上即時恢復人體網格

InstantHMR : Real-Time Human Mesh Recovery on Your Phone

AI 導讀

InstantHMR 是一系列開源的單張圖片人體網格恢復模型,針對手機推理而設,採用 Momentum Human Rig(MHR)參數模型,並只以 SAM 3D Body 數據集的公開標註訓練。

正文

Published on Nov 6

Authors:

,

Abstract

Real-time 3D human mesh recovery from a single image on mobile devices is a challenging problem with many applications, including robotics, biomechanics, AR/VR, and exergames. Current state-of-the-art models are either too slow to run efficiently on mobile devices or sacrifice accuracy for speed. We present InstantHMR, a family of open-source single-image regressors suited for mobile inference, based on the Momentum Human Rig (MHR) parametric model and trained exclusively on publicly available annotations from the SAM 3D Body dataset. Our approach achieves remarkable performance on a Samsung Galaxy S23 NPU, recovering a 6,890-vertex body mesh in 5.5 ms per person, and 0.98 ms on an NVIDIA RTX 4070 GPU. This speed surpasses all existing methods we evaluated. On mobile, it is 12x faster than the single mobile-compatible method that slightly outperforms ours in accuracy, while achieving competitive accuracy with 40.0 mm PA-MPJPE on 3DPW, 48.8 mm on EMDB and 41.7 mm on RICH. To ensure fair comparisons, we re-evaluate 11 state-of-the-art methods under a unified protocol aligned with the closest MHR-based competitors, including Meta's official MHR-to-SMPL conversion, and report their reproduction results. Additionally, we measure latency across eight different targets, ranging from desktop TensorRT to two phone NPUs. Code and models are available at https://github.com/Naturalpad-studio/InstantHMR.

View arXiv page View PDF GitHub Add to collection

Models citing this paper 1

momolesang/InstantHMR

Image-to-3D •

Updated 7 minutes ago

•

16

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.09195 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.09195 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co