跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-14AI 評分45

RoTA-Bench:透過互動式投影對齊評估 3D 空間推理能力

RoTA-Bench: Evaluating 3D Spatial Reasoning through Interactive Projection Alignment

AI 導讀

RoTA-Bench 以互動式 3D 至 2D 投影對齊,評估視覺語言模型將 2D 觀察轉化為精確 3D 旋轉控制的能力。基準包含 674 項任務及分層抽取的 100 項測試集;GPT-5.6-Sol 僅完成 17%,20 名大學生合共完成測試集四次,成功率達 100%。

正文

Published on Oct 14

Authors:

,

,

,

,

,

,

,

,

Abstract

Vision-language models struggle to convert 2D visual observations into precise 3D rotational control, showing large gaps versus humans in projection alignment tasks.

Can vision-language models turn 2D observations into 3D understanding that supports precise action? This requires inferring object geometry, anticipating the effects of rotation, and refining actions through visual feedback. We introduce RoTA-Bench to evaluate these abilities through interactive 3D-to-2D projection alignment. Given a target silhouette, a model observes a rotated object and chooses successive rotations to recover the target projection within a limited action budget. Our automated pipeline constructs silhouette-preserving 3D objects from 2D icons and uses reversible initialization to guarantee solvability, yielding 674 tasks and a stratified 100-task test set. Empirically, we find that (i) a substantial human-model gap persists: GPT-5.6-Sol succeeds on only 17% of tasks, whereas 20 undergraduate participants collectively complete the test set four times with a 100% success rate; (ii) image-space and pose-space progress can diverge: at matched states, the model more often improves silhouette overlap while worsening pose alignment than humans (19.4% vs. 10.9%); and (iii) fine-grained control is sensitive to interaction history: removing it leaves 96.8% of the model's actions at a coarse 30-degree step size and sharply reduces observed task success. These findings highlight the challenge of converting visual evidence into precise 3D control, beyond recognizing or matching individual images.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2610.17665

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.17665 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.17665 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.17665 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co