MFVSR: A Multi-Style and Fine-Grained Benchmark for Video Subtitle Removal
MFVSR: A Multi-Style and Fine-Grained Benchmark for Video Subtitle Removal
MFVSR 提出大型多風格影片字幕移除評測基準,以細粒度、空間解耦的協議評估修復保真度、內容保留、時間一致性及可靠性。基準包含來自 Real-HQ、Real-LQ 和 AI-Generated 的 3,000 段配對影片,以及 953 段真實場景影片,涵蓋 16 種語言和四類字幕特徵。六種代表性方法的實驗顯示,局部修復、區域外保留、時間一致性與整體可靠性之間存在差異。
Published on Oct 13
Authors:
,
,
,
,
Abstract
MFVSR introduces a large-scale, multi-style benchmark for video subtitle removal that evaluates restoration fidelity, preservation, temporal consistency, and reliability through fine-grained, spatially decoupled protocols.
Video subtitle removal (VSR) is an important video restoration task, yet existing evaluation remains limited by low-resolution datasets, fragmented test sets, and generic video-inpainting protocols that fail to adequately capture localized restoration errors, unintended modifications, temporal instability, and incomplete outputs. In this paper, we introduce MFVSR, a large-scale multi-style benchmark for fine-grained and reliability-aware video subtitle removal evaluation. MFVSR distinguishes itself through three key features: (1) Large-scale and diverse data, comprising 3,000 paired videos from Real-HQ, Real-LQ, and AI-Generated sources, with an auxiliary set of 953 in-the-wild real videos for real-world coverage analysis; (2) Controlled subtitle diversity, spanning 16 languages and four factors covering spatial layout, temporal behavior, visual style, and language mode; (3) Fine-grained evaluation, introducing an information-conditioned, spatially decoupled protocol that separates blind from mask-guided removal and measures Restoration Fidelity, Preservation Fidelity, Temporal Fidelity, coverage, and failures. Experiments on six representative methods reveal substantial discrepancies between local restoration, outside-region preservation, temporal consistency, and full-set reliability that are obscured by conventional full-frame metrics. MFVSR therefore provides a more comprehensive and diagnostic foundation for evaluating and advancing video subtitle removal methods.
View arXiv page View PDF GitHub Add to collection
Get this paper in your agent:
hf papers read 2610.18461
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.18461 in a model README.md to link it from this page.
Datasets citing this paper 1
siiian/MFVSR
Viewer • Updated 2 days ago • 3k • 183
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.18461 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co