跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-14AI 評分49

DeltaStreamer:邁向類人化的智能體串流影片理解

DeltaStreamer: Towards Human-Like Agentic Streaming Video Understanding

AI 導讀

開源智能體 DeltaStreamer 可持續觀看影片、記錄事件,並在記憶不足時回看視覺證據,以理解串流影片。它會比較連續抽樣影格,建立連結至原始視覺證據的結構化文字記憶,並按查詢檢索記憶及重看過往影格。在 OVO-Bench 和 StreamingBench 評測中,DeltaStreamer 整體表現優於多種現有方法;程式碼及可本地部署的互動示範亦已提供。

正文

Meet DeltaStreamer, an open-source agent that continuously watches video, remembers what happened, and revisits visual evidence when memory falls short. 🎬

Video keeps arriving, while questions can come at any time. Before a question appears, the agent cannot know which details will matter. By the time it does, the crucial moment may already have passed.

DeltaStreamer connects three capabilities:

  • Observe changes: compare consecutive sampled frames and record both scene descriptions and visual changes.
  • Organize memory: build structured textual memory with pointers back to the original visual evidence.
  • Investigate on demand: formulate a query-driven plan, retrieve relevant memories, and revisit past frames when important details are missing.

Evaluations on OVO-Bench and StreamingBench show stronger overall performance than multiple existing approaches.

💻 The code and locally deployable interactive demo are available! Upload a video, ask questions, and explore the agent’s observations, memory, and planning process.

🌐 Project page: https://bbbbchan.github.io/DeltaStreamer/
⭐ Code & demo: https://github.com/BBBBchan/DeltaStreamer

We’d love to hear your feedback! If you find this work interesting, a GitHub star or an upvote here would be greatly appreciated.

👀 A new application built on DeltaStreamer is coming soon. Stay tuned!

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co