Echo:為 Vision Language Action 模型聯合去噪動作與任務狀態訊號
Echo: Coupled Action and Task Status Signal Denoising for Vision Language Action Models
Echo 將停止與失敗訊號納入 Vision Language Action 模型,並與機械人動作一同去噪,協助機械人在任務成功時停止、失敗後啟動復原或重新規劃。框架無須逐影格進度標註,並透過令狀態訊號比動作更快完成去噪,讓後續動作生成參照更準確的狀態估計。實際機械人操作實驗顯示,Echo 能準確預測任務狀態,並持續提升策略表現。
Published on Oct 22
·
on Oct 26
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
Echo integrates stop and failure signals into a vision-language-action model to guide robot execution and recovery without fine-grained progress labels.
Recognizing task completion and failure enables robots to stop upon success and initiate recovery or replanning after failure. Existing methods augment Vision Language Action (VLA) policies with task status signal prediction to support these execution decisions. However, learning and integrating these signals can require fine-grained supervision, external monitoring models, or complex architectural designs. Moreover, the potential of task status signals to directly guide action generation remains underexplored. We present Echo, a framework that combines task status signal learning without frame-level progress annotations with a compact design for status prediction and action generation within a single VLA. Specifically, Echo represents task status with stop and failure signals, added as two dimensions of each action chunk and denoised together with robot actions. Their combination distinguishes ongoing execution, successful completion, and failure. To learn these signals without fine-grained progress annotations, Echo constructs successful, failed, and recovery trajectories with complementary supervision properties. To enable status signal-guided action generation, Echo controls interactions between the signals and actions and denoises the signals faster than the actions. These allow later action denoising steps to condition on cleaner status estimates while preserving accurate signal prediction. Extensive real-world manipulation experiments show that Echo accurately predicts task status and consistently improves policy performance.
View arXiv page View PDF Project page GitHub 1 Add to collection
Get this paper in your agent:
hf papers read 2610.31569
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.31569 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.31569 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.31569 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co