FocusVLA:以未來意圖引導視覺語言動作模型動態切換視角
FocusVLA: Future-Intent Guided Dynamic View Routing for Vision-Language-Action Models
FocusVLA 根據預測的互動意圖,在機械人操作不同階段動態切換全局與局部相機視角。在 RoboTwin 2.0 上,其平均成功率較最強基線 π_{0.5} 高 10.10 pp;真實環境評估中,成功率由 71.7% 提升至 85.0%。意圖預測與動態路由模組可整合至現有 VLA 框架,無須修改核心架構。
Published on Oct 22
·
on Oct 26
Authors:
,
Abstract
FocusVLA improves robotic manipulation by dynamically routing between global and local camera views based on predicted interaction intent across task stages.
Vision-language-action (VLA) models have become an important paradigm for robotic manipulation by unifying visual perception, language understanding, and action generation. Since reliable manipulation requires sufficient observation of objects, end-effectors, and their spatial relationships, multi-view inputs are widely used to provide complementary spatial information. However, our experiments show that existing VLA models do not fully exploit such multi-view complementarity. The policy tends to persistently rely on the wrist view, lacking the ability to dynamically adjust global-local view dependency across manipulation stages, which limits stage adaptability and robustness. To address this issue, we propose FocusVLA, a stage-aware multi-view routing framework. FocusVLA predicts future interaction intent from historical actions and uses it to guide dynamic view routing during action generation. By adaptively coordinating global and local observations across different task stages, FocusVLA improves multi-view utilization. On RoboTwin 2.0, FocusVLA improves the average success rate over the strongest baseline π_{0.5} by 10.10 pp. In real-world evaluation, FocusVLA improves the success rate from 71.7\% to 85.0\%, achieving a 13.3\% gain over π_{0.5}. Moreover, the intent prediction and dynamic routing modules of FocusVLA can be integrated into existing VLA frameworks without modifying their core architectures.
View arXiv page View PDF Add to collection
Get this paper in your agent:
hf papers read 2610.31423
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.31423 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.31423 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.31423 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co