EVAThink 如何按影片證據充足程度訓練自適應推理
EVAThink: Evidence Sufficiency-Guided Training for Adaptive Thinking in Video Understanding
EVAThink 提出按視覺證據是否充足決定直接作答或進行推理的訓練方法,讓影片 VLM 自適應分配推理。方法以兩階段強化學習訓練,無需 SFT 冷啟動,並用首 token 優勢正則化穩定訓練。模型僅用 6.7K 個整理樣本訓練,在 32 和 64 幀設定下均提升影片理解基礎模型的表現,平均勝過強基線。
EVAThink: Evidence Sufficiency-Guided Training for Adaptive Thinking in Video Understanding
When should a video VLM think, and when should it answer directly? We introduce EVAThink, which learns to make this choice based on the sufficiency of available visual evidence.
💡 Key Ideas
- Recoverable Evidence Gap Mining: Construct evidence-dense and evidence-sparse video pairs with the same question, answer, and frame budget, retaining pairs where reasoning improves accuracy on sparse views.
- Evidence-Guided Two-Stage RL: First learn evidence-based response-mode selection, then refine efficiency—with no SFT cold start.
- Stable training: First-token advantage regularization mitigates collapse into always thinking or always answering directly.
📊 Results
Trained on only 6.7K curated samples, EVAThink consistently improves upon the base model across video understanding benchmarks under both 32- and 64-frame budgets, while outperforming strong baselines on average.
🚀 Why It Matters
Visual evidence provides a useful signal for allocating reasoning effort, enabling more accurate and efficient video understanding.
💻 Code, model & datasets: EVAThink
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co