AUGUstus:統一生成與理解的自動駕駛 VLA 模型
AUGUstus: Autonomous Driving VLA Model with Unified Generation and Understanding
AUGUstus 將擴散式動作生成與自回歸 CoT 理解整合於自動駕駛 VLA 模型,推理時只需輸出動作以降低延遲。模型在 NAVSIMv1 得 94.6 PDMS、NAVSIMv2 得 90.7 EPDMS,在 nuScenes 的平均 L2 誤差為 0.27 m,平均碰撞率為 0.05%。
Published on Oct 12
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
Vision-language-action (VLA) models show strong potential for end-to-end autonomous driving by leveraging world knowledge and understanding to excel in long-tail scenarios. However, current VLAs have two limitations: 1) Degeneration into vision-action (VA) models. For low latency, regression/flow-based methods directly generate actions but underuse VLM understanding, causing unsafe, unexplainable actions. 2) Autoregressive high latency. Autoregressive methods sequentially generate chain-of-thought (CoT) and action tokens, fully leveraging VLM understanding, but high latency hinders deployment. To enable low-latency deployment while using CoT to assist action generation, we propose AUGUstus, an Autonomous-driving VLA model with Unified Generation and Understanding. We unify diffusion-based action generation and autoregressive CoT understanding in one model, where understanding only serves generation. Joint CoT supervision preserves VLM spatial understanding in shared representation for safer, more accurate trajectories. AUGUstus-mode orders action generation before CoT, so CoT supervises reliable actions during training while inference needs only action output, enabling low latency. AUGUstus-GRPO, a unified GRPO algorithm, jointly optimizes action and CoT, improving action performance. Experiments show AUGUstus achieves 94.6 PDMS on NAVSIMv1 and 90.7 EPDMS on NAVSIMv2, SOTA planning without scorer module. On nuScenes, it achieves average L2 error 0.27 m and average collision rate 0.05%, best among compared methods. To validate AUGUstus practicality, we train on in-house data with 512 NVIDIA H800 GPUs for ~2 days, evaluate on an internal 1,000 km dataset, and preliminarily deploy on a real vehicle, achieving 12 Hz operation. Project page: https://augustus-ad.github.io
View arXiv page View PDF Project page GitHub Add to collection
Get this paper in your agent:
hf papers read 2610.16985
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 1
Robotics • Updated about 6 hours ago • 9yuki-hahaha/AUGUstus
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.16985 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.16985 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co