跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 4 天前AI 評分32

UltraTex:對齊物理知識以生成高保真 PBR 紋理

UltraTex: Aligning Physical Knowledge for High-Fidelity PBR Texture Generation

AI 導讀

UltraTex 提出級聯多視角框架,結合物理知識與視覺語言模型特徵,從單張參考圖像為 3D 網格生成符合物理特性的 PBR 紋理貼圖。框架先聯合預測反照率與世界空間着色法線,再根據生成的反照率、參考圖像及材質語義先驗預測金屬度與粗糙度貼圖。實驗顯示,UltraTex 在視覺保真度、材質準確度及物理合理性方面勝過現有開源和商業方法。

正文

Published on Nov 18

Authors:

,

,

,

Abstract

UltraTex employs a cascaded multi-view framework that integrates physical knowledge and vision-language model features to accurately generate physically plausible PBR texture maps.

Generating physically based rendering (PBR) texture maps for a 3D mesh from a single reference image is highly ambiguous, as the observed appearance entangles material identity, surface reflectance, and illumination. While current generative methods produce realistic albedo maps, they still struggle to infer accurate metallic and roughness attributes for relighting. We present UltraTex, a cascaded multi-view framework that moves beyond appearance matching by integrating physical knowledge into multi-view diffusion-based PBR generation. UltraTex first jointly predicts albedo and world-space shading normals to generate more detailed albedo maps, and then predicts metallic-roughness (MR) maps conditioned on the generated albedo, reference image, and material semantic priors. To inject material semantics, a lightweight adapter transforms hidden-layer features of a vision-language model (VLM) into intrinsic material representation tokens, providing part-level knowledge anchors for MR estimation. To model material-light interaction, photometric representation alignment guides intermediate diffusion features toward ground-truth material renderings under controlled lighting. This makes metallic and roughness variations observable through highlight intensity, specular sharpness, and local reflectance contrast, providing stronger guidance for fine-grained material prediction without explicit lighting supervision. Extensive experiments show that UltraTex generates high-quality textures and outperforms existing open-source and commercial methods in visual fidelity, material accuracy, and physical plausibility.

View arXiv page View PDF Project page Add to collection

Get this paper in your agent:

hf papers read 2611.24941

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.24941 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.24941 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.24941 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co