HRoPE:同態變換相對位置編碼
HRoPE: Homography Relative Positional Encoding
HRoPE 提出以斜置 3D 平面及同態變換實現表面感知的位置編碼,改善多視角對齊與新視角合成,無需真值幾何。平面參數可在新視角合成目標下端到端預測,或由基礎模型推導;在 RealEstate10K、CO3Dv2 和 DL3DV 上,HRoPE 最佳變體均優於受評估的幾何位置編碼。
Published on Oct 20
Authors:
,
,
,
,
,
,
,
Abstract
HRoPE introduces surface-aware positional encoding using slanted 3D planes and homographies to improve cross-view alignment and novel view synthesis without requiring ground-truth geometry.
Geometric Relative Positional Encoding has become the primary mechanism for injecting spatial inductive biases into multi-view transformers. Existing designs condition attention on camera-level frustums or ray-marched depth, associating cross-view tokens through the sensor geometry. Such sensor-centric formulations, however, describe only where a token is observed from, leaving the rich surface geometry of the scene region depicted by the token. In this paper, we advocate a shift toward surface-aware positional encoding that explicitly grounds patch tokens in the geometry of physical surfaces. We introduce HRoPE, which represents the local geometry of each patch as a slanted 3D plane, following the slanted support-window assumption of classical multi-view stereo. We inject token-level, plane-induced homographies into attention as relative transformations. This equips the transformer with a geometric prior for rectifying perspective distortions and aligning patch features across viewpoints. Our encoding requires no ground-truth geometry: the plane parameters can be predicted end-to-end under a view-synthesis objective alone, or derived from foundation models. Extensive experiments on RealEstate10K, CO3Dv2, and DL3DV show that our best variant of HRoPE consistently outperforms the evaluated geometric positional encodings for novel view synthesis. Extensive ablations and analysis show the effectiveness of the proposed encoding. Please refer to our project page at: https://gaohchen.github.io/HRoPE
View arXiv page View PDF Project page GitHub Add to collection
Get this paper in your agent:
hf papers read 2610.28284
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2610.28284 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2610.28284 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2610.28284 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co