跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-22AI 評分42

Dual Exam:多模態智能體與世界模型的受控評測

Dual Exam: Controlled Evaluation of Multimodal Agents and World Models

AI 導讀

Dual Exam 分別評測多模態智能體與世界模型在不同領域的表現,並揭示兩者在試點測試中未能共同成功。智能體評測涵蓋 1,088 個項目及 15 個報告類別,GPT 6 Astra 的加權分數為 31.3;世界模型評測涵蓋 400 個案例及八種情境,GPT-Image-2 的整體分數為 21.7。兩組分數採用不同任務和指標,不能直接比較;150 個案例的配對試點中沒有任務成功。

正文

Published on Oct 22

Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

Dual Exam evaluates multimodal agents and world models separately across diverse domains, revealing uneven performance and no coupled success in pilot tests.

World Models (WMs) can support Multimodal Agents (MAs) through simulated experience, while Agent trajectories can inform World Model refinement. Evaluating this interaction requires separate evidence about action selection and state evolution. We introduce Dual Exam, which tests Agents under fixed environment response mechanisms and World Models under fixed action interventions across physical, digital, social, and scientific domains. The Agent track compares 10 configurations on 1,088 items in 15 reporting categories. The World Model track contains 400 cases across eight scenarios; 15 configurations have full coverage and one covers six scenarios. GPT 6 Astra leads the case-weighted Agent Index at 31.3, and GPT-Image-2 leads the full-coverage WM Overall at 21.7. These scores use different tasks and metrics and are not directly comparable. A 150-case pilot of one coupled pairing records zero task successes and motivates component-level diagnosis. Results reveal uneven task performance and failures to preserve task-relevant state. Their value for predicting coupled success or sustained reciprocal learning remains to be established.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2610.31066

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.31066 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.31066 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.31066 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co