DirCast:以單一串流影片語言模型實時導播及解説電競賽事
DirCast: Live Esports Directing and Commentary with a Single Streaming Video-Language Model
DirCast 是單一串流影片語言模型,能根據過往畫面選擇鏡頭並生成即時解説,負責電競直播的導播與解説。研究團隊以 27 場職業 Dota 2 賽事建立數據集,DirCast 的導播表現優於規則式及零樣本導播,包括 GPT-5。在 Proact-VL 評測中,其解説有 29.2% 的比較勝過 GPT-4o;觀看人工導播直播的 11 個串流解説模型中,最佳者為 19.4%。
Published on Oct 22
Authors:
,
,
,
,
,
,
Abstract
DirCast is a streaming video language model that simultaneously directs live esports broadcasts by selecting cameras and generates real-time commentary using only past context.
A live esports broadcast needs a director who chooses which camera goes on air and a caster who talks over that choice, every second and without knowing what comes next. Streaming video language models have learned to commentate, but only over a broadcast that a human director has already produced. We study live broadcast production, in which a model receives the raw camera of every player and must both direct and commentate from the past alone. We present DirCast, a single streaming video language model that does both. Every second it scans all cameras at low resolution, decides with a hold-or-switch director whether and where to cut, and reads the chosen camera at high resolution before it speaks. Its context keeps what went on air and what was said and lets the other views expire, which bounds the cost of a stream of any length. We build a dataset of 27 professional Dota 2 matches with a camera for every hero, the human director's choices and the casters' commentary. DirCast directs better than rule-based and zero-shot directors including GPT-5, and its commentary wins 29.2 percent of comparisons against GPT-4o under the Proact-VL protocol, against 19.4 percent for the strongest of eleven streaming commentators that watch the human broadcast.
View arXiv page View PDF Project page Add to collection
Get this paper in your agent:
hf papers read 2610.31734
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.31734 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.31734 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.31734 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co