跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 23 天前AI 評分44

CausalWAM:在世界動作模型中學習動作成因

CausalWAM: Learning the Causes of Actions in World Action Models

AI 導讀

CausalWAM 在預訓練的世界動作模型動作頭加入稀疏路由,將動作生成與場景預測依賴的潛在變數分開,毋須假設時間獨立性。理論證明,在稀疏性約束下,動作生成所用的潛在變數只由與動作相關的潛在變數決定,真實結構可識別至變數排列。合成數據及真實機械人實驗驗證了理論,並展示閉環成功效率有所提升。

正文

Published on Oct 30

Authors:

,

,

,

Abstract

Causal World Action Models enforce sparse routing to isolate action-relevant latent variables, ensuring identifiable causal structure without requiring temporal independence assumptions.

World action models (WAMs) learn latent variables from observations and use these to both predict the evolution of the scene and to generate actions. The prediction has to be of the whole scene, whereas only a portion of the scene causes actions. WAMs fitted to demonstrations do not, in general, guarantee that they will generate actions solely from the latent causes of the demonstrated actions (the action-relevant latent variables), as the model could just as well learn to imitate in this way whilst entangling the action-relevant latent variables with the nuisance variables. We therefore separate out what causes action from what prediction depends on. We prove that under a sparsity constraint the latent variables used to generate actions are an invertible function of the action-relevant latent variables alone and the true structure is identified up to a permutation of the latent variables. This requires neither sufficient temporal dependence nor any assumptions on how the unobserved regimes evolve and holds even when the action-relevant latent variables are statistically dependent on the rest. We therefore propose CWAM (Causal WAM), which incorporates the constraint into a pretrained WAM by adding a sparse routing path to its action head, with the world modeling objective remaining unchanged. Experiments on both synthetic data and real-world robots validate the theory as well as showcase the improved efficiency in closed-loop success.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2610.42096

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.42096 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.42096 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.42096 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co