跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 3 天前AI 評分45

WeVisOne-VL:由物件到像素的統一視覺感知

WeVisOne-VL: Unified Visual Perception from Objects to Pixels

AI 導讀

WeVisOne-VL 透過結構化 token 預測統一物件層級與像素層級的視覺感知,支援物件偵測、定位、計數、OCR、分割及摳圖。模型採用輕量級像素解碼器及多階段訓練,在逾 30 項基準測試中,物件層級與像素層級任務均表現領先,並能穩健拒絕物件不存在的查詢。團隊將 WeVisOne-VL 開源。

正文

Published on Oct 22

Authors:

,

,

,

,

,

,

Abstract

WeVisOne-VL unifies object-level and pixel-level visual perception via structured token prediction, supporting detection, localization, counting, OCR, segmentation, and matting with a lightweight pixel decoder and multi-stage training.

Existing vision-language models (VLMs) remain unreliable for fine-grained visual perception. In this report, we present WeVisOne-VL (WeChat Vision All-in-One), a powerful VLM that unifies object-level and pixel-level perception through structured next-token prediction. It supports multiple visual tasks including object detection, referring localization, counting, OCR, segmentation, and matting, enabling localization at any user-specific granularity, from points and boxes to masks and alpha mattes. Architecturally, we integrate a lightweight pixel decoder into the VLM via a special <OBJ> token to generate instance-level pixel outputs. We train the model with a three-stage curriculum SFT followed by mixed-task RL. Across over 30 benchmarks, WeVisOne-VL demonstrates leading performance on both object-level and pixel-level tasks, while maintaining robust rejection for object-absent queries. By releasing WeVisOne-VL to the open-source community, we hope to advance VLMs from broad visual understanding toward truly reliable perception systems for real-world deployment.

View arXiv page View PDF Project page GitHub Add to collection

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.31329 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.31329 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.31329 in a Space README.md to link it from this page.

Collections including this paper 1

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co