跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 4 天前AI 評分39

WaveView:新視角就在雜訊之中

WaveView: The Novel View Is in the Noise

AI 導讀

WaveView 將扭曲後的來源影像注入預訓練生成器初始雜訊的相位,以生成新視角,並保留原有架構、只增加極少額外開銷。在 DL3DV 基準的所有重疊區間均勝過基線;最困難區間中,模型在共視區域的 PSNR 比 MetaView 高 0.84 dB,速度快 2.1 倍。以相同雜訊微調 AnyView,令其在 AnyViewBench 的零樣本 PSNR 從 11.58 提升至 12.35 dB。

正文

Published on Nov 18

Authors:

,

,

,

Abstract

Generative novel view synthesis (NVS) employs a diffusion model to render a static or dynamic scene from a target camera view. Explicit warp methods complete a reprojection of the source with video diffusion models, and implicit methods encode the camera parameters or 3D cues. Both add inference overhead, and the generated layout often drifts from the ground truth. We present WaveView, which injects the warped source into the phase of the initial noise of a pretrained generator. The Dual-Tree Complex Wavelet Packet Transform (DT-CWPT) allows local and anisotropic phase injection. The generator is thus constrained less in disoccluded regions and along the epipolar line. WaveView keeps the architecture and adds negligible overhead. On the DL3DV benchmark, it outperforms all baselines in every overlap bin. In the hardest bin, it gains 0.84 dB PSNR on the covisible region over MetaView, which shares its generator, while running 2.1 times faster. For dynamic NVS, fine-tuning AnyView with the same noise raises its zero-shot PSNR on AnyViewBench from 11.58 to 12.35 dB.

View arXiv page View PDF Add to collection

Get this paper in your agent:

hf papers read 2611.23994

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.23994 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.23994 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.23994 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co