跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-13AI 評分48

Game2Real-Bench: Do Toy Games Reveal and Transfer to Real-World Visual Reasoning?

Game2Real-Bench: Do Toy Games Reveal and Transfer to Real-World Visual Reasoning?

AI 導讀

Game2Real-Bench 評估玩具遊戲中的能力能否反映並遷移至真實世界視覺推理,涵蓋細粒度感知、空間推理、約束推理及序列規劃。研究以 1,000 個遊戲樣本和 400 個真實世界樣本評估 25 個 VLM,兩者的 Pearson 和 Spearman 相關係數均為 0.935。Game2Real-Dataset 收錄近 24K 個經驗證的遊戲樣本,涵蓋 18 項任務及 65 個 QA 家族。

正文

Published on Oct 13

Authors:

,

,

,

,

,

,

,

Abstract

Visual reasoning is an important capability for vision-language models (VLMs) to understand visual evidence, spatial structure, constraints, and state changes. Existing evaluations mainly rely on real-world data or procedurally generated tasks. Real-world data preserve natural complexity, while procedural games provide controllable generation and verifiable solutions. However, it remains unclear whether abilities measured in toy games correspond to real-world visual reasoning and whether game examples can support transfer. We introduce Game2Real-Bench, a benchmark that studies these connections across four capability groups, including fine-grained perception, spatial reasoning, constraint reasoning, and sequential planning. We construct 1,000 procedurally generated game samples with executable verification and curate 400 real-world samples aligned by shared reasoning requirements rather than visual similarity. We evaluate 25 representative VLMs and observe strong game-to-real consistency, with Pearson and Spearman correlations of 0.935. We further study one-shot game-to-real transfer on four models. Constraint reasoning improves for several models, while fine-grained perception declines with game demonstrations. We also construct Game2Real-Dataset with nearly 24K verified game samples across 18 tasks and 65 QA families. Our benchmark, dataset, and code are available at https://github.com/QingAnLiu/Game2Real-Bench.

View arXiv page View PDF GitHub 0 Add to collection

Get this paper in your agent:

hf papers read 2610.18834

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.18834 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.18834 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.18834 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co