跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 6 天前AI 評分49

VAE Rhythm:追蹤時間解碼痕跡以偵測 AI 生成影片

VAE Rhythm: Temporal Decoding Traces for AI-Generated Video Detection

AI 導讀

VAE Rhythm 利用生成影片解碼過程留下的週期性痕跡,偵測 AI 生成影片;論文提出無需訓練的 phase scan,透過不同起始偏移重建影片並測量重建誤差的週期性。

正文

Published on Nov 16

·

Submitted by

Ke Sun

on Nov 19

Authors:

,

,

Abstract

Visible artifacts are an unreliable cue for detecting generated videos, because newer generators learn to remove them. We instead detect a trace left by the generation pipeline itself. Most video generators decode latents with a 3D causal VAE that groups consecutive frames in time, so the fidelity of generated frames rises and falls periodically with their position in a group. We call this periodic trace VAE Rhythm. Real videos are captured frame by frame and do not have it. To reveal it without training, we propose a phase scan. The scan reconstructs a clip with an off-the-shelf VAE from successive start offsets and measures the periodicity of the reconstruction error across these offsets. We find VAE Rhythm in most of the 39 variants of 31 generators we test, including the closed-source Sora, Kling 3.0 and Seedance 2.0. We use the rhythm as a zero-shot score, as a plug-in for existing detectors and as a data engine that pairs real videos with their VAE reconstructions to train our detector CaDet. On DF26, the training-free rhythm score outperforms all 15 retrained baselines, and as a plug-in it improves all 19 tested detectors by 6.7% to 23.7% AUROC. CaDet achieves the best AUROC on AIGVDBench, DF26 and three 2026 closed-source models, and its variant trained without any generated video still exceeds 90% on AIGVDBench.

View arXiv page View PDF Project page GitHub 1 Add to collection

Get this paper in your agent:

hf papers read 2611.21114

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

Jack97/CaDet

Video Classification •

Updated 1 day ago

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.21114 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.21114 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co