跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 4 天前AI 評分49

RoughCut-Bench:大型視覺語言模型自動影片粗剪基準測試

RoughCut-Bench: A Benchmark for Automatic Video Rough-Cut with Large Vision-Language Models

AI 導讀

RoughCut-Bench 為大型視覺語言模型自動影片粗剪建立基準,並提出引導模型生成結構化剪輯計劃的智能體工作流程。基準涵蓋 101 個視覺案例(831 段原始影片、1,476 個精彩片段標註)及 84 個語音案例;評測顯示,現有模型仍難以產生符合專家剪輯計劃的結果。

正文

Published on Nov 18

Authors:

,

,

,

,

,

,

,

,

Abstract

A new benchmark and agentic workflows assess vision-language models for automatic video rough-cut, revealing current models struggle to match expert cut plans.

Video rough-cut is a core stage in media production workflows, organizing raw media materials into an initial video cut. Despite recent advances in large vision-language models (LVLMs) for video-related tasks, automatic rough-cut remains underexplored, without a comprehensive benchmark for evaluation or mature workflows for producing executable cut plans. To address the evaluation gap, we introduce RoughCut-Bench, which covers two practical settings: (1) a visually driven setting over video cases, covering highlight detection and selection, source-video ordering, and adherence to user requirements when provided; and (2) a speech-driven setting over automatic speech recognition (ASR) transcripts, covering filler removal, expression deduplication, and low-value content trimming. Across these settings, the benchmark contains 101 visually driven cases, including 831 raw videos with 1,476 highlight annotations. It also includes 84 speech-driven cases, each consisting of an ASR transcript with annotated cleanup spans. The evaluation compares cut plans with these annotations in both settings and additionally uses a human-aligned agentic evaluator to assess rendered-cut quality in the visual setting. To apply LVLMs to automatic rough-cut, we further propose agentic workflows that guide them to produce structured cut plans from input materials. Experiments show that current LVLMs remain limited in producing expert-aligned cut plans. Our benchmark, code, and prompts are released at https://whalesong-zrs.github.io/RoughCut-Bench-Project-Page.

View arXiv page View PDF Project page GitHub 1 Add to collection

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.24098 in a model README.md to link it from this page.

Datasets citing this paper 1

zhaors00/RoughCut-Bench

Updated about 2 hours ago

•

9

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.24098 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co