ConfigWM:具可配置感知能力的世界模型
World Models with Configurable Perception
ConfigWM 以任務描述引導視覺嵌入向量映射至任務專屬狀態空間,在多種環境中平均勝過最強競爭方法 22.3%。它在物理量探測的 Pearson r 提升 +0.365,在受幹擾至乾淨環境的檢索表現提升 +75.5%。模型在任務專屬狀態空間中學習受動作條件控制的動態,以支援規劃。
Published on Oct 20
Authors:
,
,
,
Abstract
ConfigWM uses task descriptions to steer visual embeddings into task-specific state spaces, filtering irrelevant noise for robust planning.
Real-world observations are noisy and often contain excessive task-irrelevant information. Effective world modeling and planning need to abstract observations into world state representations while filtering out irrelevant information. However, encoders in existing world models are typically non-adaptive, leading to state representations that are easily distracted by task-irrelevant information. As a result, the model may not selectively filter observations to cater to different task demands. To address this problem, we introduce ConfigWM, which realizes configurable perception through task-conditioned state extraction. Given a language description of the task at hand, ConfigWM uses it as a configuration signal to steer how visual embeddings are mapped into a task-specific state space, selectively preserving information relevant to the current task while suppressing task-irrelevant variations. Action-conditioned dynamics are then learned in this task-specific state space for planning. We evaluate ConfigWM in environments with increasing levels of distraction. While existing methods exhibit substantial declines in planning success rate as the environments become increasingly noisy, ConfigWM remains comparatively stable and outperforms the strongest competing method by 22.3% on average across diverse environments. Consistent gains in physical-quantity probing (+0.365 Pearson r) and distracted-to-clean retrieval (+75.5%) further indicate that ConfigWM learns states that preserve task-relevant information while remaining robust to distractors, supporting reliable world modeling and planning in noisy worlds. Project Page: https://configwm.github.io
View arXiv page View PDF Project page GitHub Add to collection
Get this paper in your agent:
hf papers read 2610.27914
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.27914 in a model README.md to link it from this page.
Datasets citing this paper 1
YijunShen/ConfigWM
Updated about 14 hours ago • 545
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.27914 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co