跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 4 天前AI 評分47

Game2Player:透過環境與玩家協同開發,擴展視覺智能體的遊戲體驗

Game2Player: Scaling Gameplay Experience for Visual Agents through Environment-Player Co-Development

AI 導讀

Game2Player 提出協同開發遊戲環境與玩家的框架,大規模收集多元且可驗證的遊戲體驗。團隊建成568款經驗證的網頁遊戲、3,436項任務,收集15.7K條軌跡(307小時遊戲時間),並保留50款遊戲作為 PlayerBench。

正文

Published on Nov 18

#2 Paper of the day

Authors:

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

Games are a rich testbed for visual agents, demanding perception, long-horizon planning, and precise control. However, collecting human gameplay is costly, and learning from gameplay videos requires inferring missing actions. Existing datasets also cover a limited range of games, often without explicit tasks or verifiable outcomes. To address these gaps, we introduce Game2Player, a framework that co-develops game environments and players to collect diverse and verifiable gameplay experience at scale. In the Game2Player loop, a Builder agent adapts existing web games, exposes their internal state, and defines tasks with state-based progress measures and success checks. A Coding Player and a VLM Player then attempt the tasks and report problems to the Builder for repair, so that play serves as both environment validation and training data collection. With Game2Player, we build 568 verified web games with 3,436 tasks, collect 15.7K trajectories (307 hours of gameplay), and hold out 50 games as the benchmark PlayerBench. To evaluate the collected experience as training data, we train VLM agents with progress-weighted SFT, assigning greater weight to steps that advance task progress. Game2Player-9B improves progress from 14.3% to 31.2% on PlayerBench and from 30.0% to 53.1% on the external GameWorld benchmark. More broadly, our work suggests a path for visual agents to scale their gameplay experience by building, verifying, and learning from existing game worlds.

View arXiv page View PDF Project page GitHub 21 Add to collection

Models citing this paper 2

game2player/Game2Player-9B

Image-Text-to-Text •

9B •

Updated about 1 hour ago

•

126

•

3

game2player/Game2Player-4B

Image-Text-to-Text •

5B •

Updated about 1 hour ago

•

112

•

1

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.24154 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.24154 in a Space README.md to link it from this page.

Collections including this paper 1

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co