跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-22AI 評分41

LeWorldModel 能否保留局部動作幾何?

Does LeWorldModel Preserve Local Action Geometry?

AI 導讀

LeWorldModel(LeWM)的主導動作方向與環境中的方向存在偏差:Reacher 約為 36°,OGBench Cube 約為 42°。動作擾動幅度增加十倍,幾何差異在 Reacher 約減少 70%,在 Cube 約減少 47%。在未見過的動作反應幅度預測上,LeWM 的幾何指標不及環境誘發的度量準確。

正文

Do world models actually understand how actions affect the future?

We investigate whether LeWorldModel (LeWM) preserves the local geometry of action effects, rather than just predicting future representations.

Using action-Jacobian Gram matrices and matched simulator counterfactuals, we find:

  • Directional mismatch: The dominant action directions differ by approximately 36° on Reacher and 42° on OGBench Cube.
  • Scale dependence: Increasing action perturbations tenfold reduces geometric discrepancy by roughly 70% on Reacher and 47% on Cube.
  • Representation dependence: The measured geometry changes substantially more across perturbation scales in visual embeddings than in physical-state coordinates.
  • Held-out validation: LeWM's geometry predicts unseen action-response magnitudes less accurately than the environment-induced metric.

Our takeaway: Evaluating world models requires understanding not only their predictions, but also how their predictions respond to changes in actions.

We'd love to hear your thoughts, particularly on how these geometric discrepancies might affect model-based planning and control!

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co