跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 12 天前AI 評分33

EVAThink 如何按影片證據充足程度訓練自適應推理

EVAThink: Evidence Sufficiency-Guided Training for Adaptive Thinking in Video Understanding

AI 導讀

EVAThink 提出按視覺證據是否充足決定直接作答或進行推理的訓練方法,讓影片 VLM 自適應分配推理。方法以兩階段強化學習訓練,無需 SFT 冷啟動,並用首 token 優勢正則化穩定訓練。模型僅用 6.7K 個整理樣本訓練,在 32 和 64 幀設定下均提升影片理解基礎模型的表現,平均勝過強基線。

正文

EVAThink: Evidence Sufficiency-Guided Training for Adaptive Thinking in Video Understanding

When should a video VLM think, and when should it answer directly? We introduce EVAThink, which learns to make this choice based on the sufficiency of available visual evidence.

💡 Key Ideas

  • Recoverable Evidence Gap Mining: Construct evidence-dense and evidence-sparse video pairs with the same question, answer, and frame budget, retaining pairs where reasoning improves accuracy on sparse views.
  • Evidence-Guided Two-Stage RL: First learn evidence-based response-mode selection, then refine efficiency—with no SFT cold start.
  • Stable training: First-token advantage regularization mitigates collapse into always thinking or always answering directly.

📊 Results

Trained on only 6.7K curated samples, EVAThink consistently improves upon the base model across video understanding benchmarks under both 32- and 64-frame budgets, while outperforming strong baselines on average.

🚀 Why It Matters

Visual evidence provides a useful signal for allocating reasoning effort, enabling more accurate and efficient video understanding.

💻 Code, model & datasets: EVAThink

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co