TCoVP:跨越時空進行視覺思考,以時空視覺證據為基礎推理影片分割
Think Visually Across Space and Time: Grounded Reasoning for Video Segmentation
TCoVP 提出一條時空定位的影片推理鏈,將實體與帶時間戳的視覺證據連結,以改善影片分割的推理和遮罩預測。TCoVP-SFT-15k 和 TCoVP-RL-13k 用於透過監督式微調及推理鏈對齊的強化學習學習此表示方式。在五個 VRS 評測基準和三種模型骨幹上的實驗顯示 TCoVP 表現出色,所有模型和程式碼將公開發布。
Published on Oct 18
Authors:
,
,
,
,
Abstract
TCoVP introduces a spatiotemporally grounded video reasoning chain that links entities to timestamped visual evidence for segmentation, improving reasoning and mask prediction across benchmarks.
Video Reasoning Segmentation (VRS) requires a model to identify an implicitly described target and predict its pixel-level mask trajectory, while resolving the spatial relations and temporal events that determine the answer. Text-only Chain-of-Thought (CoT) can explain a target choice without making the underlying visual references explicit, leaving a video reference gap between linguistic inference and the evidence distributed across frames. We introduce Temporal Chain of Video Primitives (TCoVP), a spatiotemporally grounded form of Video CoT that organizes query-relevant observations into a chronological reasoning chain. Each primitive associates an entity reference with temporal support and timestamped spatial evidence, and the chain interleaves these references with language to guide reasoning about which entity is relevant, when the queried event holds, and where its evidence appears. The selected target primitives then provide box prompts and temporal support for video mask prediction. We construct TCoVP-SFT-15k and TCoVP-RL-13k to learn this representation through supervised fine-tuning and chain-aligned reinforcement learning. Extensive experiments across five VRS benchmarks and three model backbones demonstrate the strong performance of TCoVP, highlighting the effectiveness of organizing spatial and temporal evidence within the reasoning process. All models and code will be publicly released. Project page: https://victor-wjw.github.io/TCoVP/
View arXiv page View PDF Add to collection
Get this paper in your agent:
hf papers read 2610.25090
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.25090 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.25090 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.25090 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co