跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-08AI 評分45

AI 智能體能否靠學習登頂?評估長期遊戲智能體競賽中的啟發式學習

Can AI Agents Learn Their Way to the Top? Evaluating Heuristic Learning in a Long-Running Game Agent Competition

AI 導讀

研究提出對抗式啟發式學習(AHL),並以 AAArena 評估 AI 智能體在模型權重固定下修訂遊戲策略的能力。AAArena 收錄 12 款對抗遊戲及 1,920 個存檔人類程式;Opus5.5 配合 Claude Code 獲得 6 枚金牌,但沒有受評配置登上其餘 6 個人類排行榜的榜首。

正文

Published on Oct 8

Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

Adversarial games have driven advances from heuristic search to reinforcement learning, yet learning and adapting strategies from limited samples remain challenging. AI agents offer an alternative by turning game experience into revisions of executable policies. Building on heuristic learning (HL), we formalize Adversarial Heuristic Learning (AHL), a paradigm that uses AI agents as learning engines to refine game policies and supporting software while keeping model weights fixed. We introduce AAArena, a benchmark comprising 12 authentic adversarial games and 1,920 archived human programs, with an evaluation protocol modeled on real-world game competitions. Agents interpret rules, choose opponents, analyze replays, and revise game agents to achieve their highest ranking within fixed match and evaluation budgets. We evaluate completedmodels model and harness configurations: Opus5.5 with Claude Code earns 6 gold medals, while no evaluated configuration tops the remaining 6 human ladders. Performance is generally weaker in games with more complex rule specifications. Further experiments show that opponent selection and dense feedback support policy improvement, and that agents learn from both on-policy replays of their own matches and off-policy replays of other players' matches. These results highlight HL's potential in adversarial games and identify persistent challenges in game understanding, strategy implementation, and long-horizon policy development.

View arXiv page View PDF Project page GitHub 24 Add to collection

Get this paper in your agent:

hf papers read 2610.12341

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.12341 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.12341 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.12341 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co