跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-09AI 評分37

SpatialASM: Internalizing Active Mentalization for Spatial Reasoning

SpatialASM: Internalizing Active Mentalization for Spatial Reasoning

AI 導讀

SpatialASM提出主動空間心智化(ASM),訓練大型視覺語言模型主動規劃相關視角,並在內部想像從這些視角可見的內容,以進行空間推理。訓練框架使用 allocentric 新視角生成器,合成「規劃—想像—推理」軌跡及可自動驗證的視角轉換任務。SpatialASM在四種大型視覺語言模型骨幹和七項空間基準測試中提升空間推理表現,同時保留一般視覺能力;推理時無需額外視角或渲染器。

正文

With SpatialASM, we explore whether LVLMs can go beyond passively observing the given images and instead actively reason by planning task-relevant viewpoints and mentally imagining what should be visible from them.

We introduce Active Spatial Mentalization (ASM) and build a scalable training framework around it. SpatialASM uses an allocentric novel-view generator as training-time scaffolding to synthesize explicit plan-imagine-reason trajectories and automatically verifiable perspective-taking tasks. In this way, models learn both when to seek missing spatial evidence and how to reconstruct it internally without requiring additional views or a renderer at inference time.

This is our attempt to bring a more human-like form of active spatial exploration into LVLMs and alleviate the scarcity of high-quality spatial reasoning supervision. Across four LVLM backbones and seven spatial benchmarks, SpatialASM improves spatial reasoning performance while preserving general visual capabilities.

We’d love to hear your thoughts and feedback!

image

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co