跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-07AI 評分40

Systematic Multi-Agent Vision-and-Language Navigation: Formulation, Benchmark, and Method

Systematic Multi-Agent Vision-and-Language Navigation: Formulation, Benchmark, and Method

AI 導讀

研究將多智能體視覺語言導航系統化建模為受約束的協調問題,並提出導航系統 TRISS。MAVLN 基準包含 11,724 個回合,涵蓋 145 個場景及最多四個智能體的團隊,並設有三種指令模式。TRISS 結合基於大語言模型的子任務排程器、共享拓撲記憶及避碰執行機制;實驗顯示,排程、規劃與執行仍有改進空間。

正文

Abstract

Vision-and-Language Navigation (VLN) has largely focused on a single agent following a single instruction, yet many real-world applications require teams of robots to tackle tasks beyond the capabilities of any individual agent. We present Systematic Multi-Agent Vision-and-Language Navigation, providing, to our knowledge, the first systematic formalization of multi-agent VLN as a constrained coordination problem: each mission consists of subtasks carrying dependency and resource constraints (presence locks and holding chains). A verified four-stage crafting pipeline instantiates the task as MAVLN, comprising 11,724 episodes across 145 scenes with teams of up to four agents under three instruction regimes, accompanied by tailored constraint-aware metrics. We further present TRISS, a coordination-ready navigation system coupling an LLM-based subtask scheduler, a shared topological memory that turns each agent's exploration into team knowledge, and a conflict-aware execution mechanism that realizes simultaneous intentions as collision-free routes. Extensive experiments establish TRISS as a comprehensive baseline and reveal substantial room for improvement across scheduling, planning, and execution, highlighting the challenges of coordinating under MAVLN task constraints. Project page: https://xyz9911.github.io/mavln.

View arXiv page View PDF Project page GitHub 5 Add to collection

Get this paper in your agent:

hf papers read 2609.35965

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2609.35965 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2609.35965 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2609.35965 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co