OmniLatent:以統一潛在空間進行 3D 部件建模
OmniLatent: Unified Latent for 3D Part Modeling
OmniLatent 以共享潛在空間聯合編碼幾何、形變、外觀及二元部件 ID,從單張圖像生成具部件感知能力的 3D 資產。模型可在單次推理中生成幾何、形變、紋理及表面部件 ID,並支援互動式分割、細化、部件細分及遮擋部件補全。
Published on Nov 6
Authors:
,
,
,
,
,
,
,
Abstract
OmniLatent jointly encodes geometry, deformation, appearance, and part identifiers in a shared latent space to generate and interactively edit part-aware 3D assets from a single image, including segmentation, refinement, subdivision, and amodal completion.
3D part decomposition is a central capability for editable asset creation, yet existing workflows typically segment a completed mesh as a post-processing step, making the result sensitive to geometric artifacts, texture ambiguity, and limited part-level annotations. We present OmniLatent, a unified latent modeling framework for 3D part decomposition. Instead of predicting part labels in isolation, OmniLatent learns a shared latent space that jointly encodes geometry, deformation, appearance, and binary part IDs, allowing data-rich geometric and visual priors to support data-scarce part learning. Given a single input image, the base model generates geometry, deformation, texture, and surface part IDs in one pass, producing a part-aware 3D asset without a separate segmentation stage. We further tune the pretrained model for two extensions: a point-prompt adapter that maps arbitrary 3D point prompts with binary part IDs into latent tokens for full segmentation, refinement, and part subdivision, and an amodal part completion model that completes partial surface masks into a coherent full-object decomposition through dynamic per-part token allocation, cross-attention to the given geometry latent, and alternating part-local and global attention. Extensive experiments show that OmniLatent produces semantically meaningful part segmentations with precise boundaries, supports interactive part editing, and completes partial part observations while preserving global object consistency.
View arXiv page View PDF Add to collection
Get this paper in your agent:
hf papers read 2611.09055
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2611.09055 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2611.09055 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2611.09055 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co