跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-08AI 評分39

GATOR: Generative and Agentic 3D Object Reconstruction From Casual Images

GATOR: Generative and Agentic 3D Object Reconstruction From Casual Images

AI 導讀

GATOR 是一套生成式與智能體式框架,可從一張或多張日常影像重建具紋理的 3D 物件資產及其場景相對姿態。框架結合 RGB、目標遮罩與 pointmap 特徵,並透過觀察引導的編輯、渲染及檢視流程修整幾何與紋理;在稀疏觀察下,重建結果具幾何和外觀保真度,亦適用於場景級模擬。

正文

Published on Oct 8

Authors:

,

,

,

Abstract

Reconstructing complete, scene-aligned 3D objects from casual images requires integrating sparse, uncertain observations and inferring surfaces hidden by occlusions. We present GATOR, a generative and agentic framework that recovers textured object assets and their scene-relative pose from one or more images. Our local modality mixer couples patch-aligned RGB, target-mask, and pointmap features before cross-view reasoning, preserving scene context while distinguishing the target from its surroundings. Text-guided semantic conditioning complements these spatial cues with category names and object captions through stage-specific adapters for structure, geometry, and appearance generation. The generated asset initializes a multimodal agent, providing instance-specific geometry and pose for targeted structural and texture refinement through an observation-guided edit-render-review loop. Across synthetic objects, cluttered tabletops, and indoor scenes, GATOR achieves strong geometric and appearance fidelity while recovering scene-relative pose from sparse observations. Time-budget comparisons and scene-level simulation further demonstrate the reconstruction efficiency and simulation readiness. Project page: https://research.nvidia.com/labs/lpr/gator/

View arXiv page View PDF Project page Add to collection

Get this paper in your agent:

hf papers read 2610.11215

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.11215 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.11215 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.11215 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co