跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 29 天前AI 評分44

AV-FABLE:長影片中的視聽篡改取證

AV-FABLE: Audio-Visual Manipulation Forensics in Long-Form Videos

AI 導讀

AV-FABLE 提出面向長影片稀疏視聽篡改的基準,並顯示分開的時間解碼器比語言輸出更能提取取證訊號。基準包含 16,650 對原始與篡改影片,總長 998 小時,並採用 27 種編輯配置;視聽大型語言模型的零樣本提示在篡改偵測上接近隨機水平。NFSR 以分開的音訊和視覺時間解碼器讀取凍結的感知特徵,在同分佈及三種分佈外設定中均取得最佳視聽定位表現,基準、程式碼和模型權重將公開發布。

正文

Published on Oct 24

Authors:

,

,

,

,

,

,

,

,

,

Abstract

AV-FABLE introduces a long-form audio-visual benchmark for sparse manipulations, showing that frozen perception features of audio-visual large language models contain forensic evidence best recovered via separate temporal decoders rather than language outputs.

Localized AI manipulations in long-form videos often affect brief events within otherwise authentic content, making video-level classification insufficient for forensic analysis. Existing audio-visual deepfake benchmarks largely focus on short talking-head clips, while long-form temporal forensics remains predominantly visual. We introduce AV-FABLE, a dual-timeline benchmark for sparse manipulations in open-scene long-form audio-visual videos. AV-FABLE contains 16,650 pristine--manipulated twin pairs (998 hours) created with 27 editing configurations, with separate audio and visual timelines that enable modality-specific temporal localization and expose errors hidden by joint-timeline evaluation. On AV-FABLE, zero-shot prompting of audio-visual large language models (AV-LLMs) yields near-chance detection and poor temporal localization. In contrast, supervised readouts of their frozen perception features recover strong forensic signals, suggesting manipulation evidence is encoded in these representations but not effectively exposed through language outputs. Motivated by this observation, we propose NFSR(Native Forensics via Separated Readouts), which reads frozen AV-LLM features with separate audio and visual temporal decoders. NFSR achieves the best audio-visual localization performance in-domain and across all three out-of-distribution settings, including transfer to held-out videos from an external long-video forensic benchmark. AV-FABLE, code, and model weights will be publicly released.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2610.33413

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.33413 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.33413 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.33413 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co