GlyphAtlas:分離筆畫細節與版面配置的場景文字合成方法
GlyphAtlas: Disentangling Stroke Detail from Layout for Scene Text Synthesis
GlyphAtlas 是一個建基於 FLUX.1-Fill-dev 的場景文字合成模型,透過分離文字版面配置與筆畫繪製,改善小字、密集多行文字及複雜文字系統的合成效果。模型以中文和英文訓練,並可零樣本泛化至日文、韓文和阿拉伯文。團隊開源程式碼、權重及包含 1.5M 張場景文字圖片的 GlyphAtlas-Data-1.5M。
🚀 Excited to introduce GlyphAtlas, a scene text synthesis model built on FLUX.1-Fill-dev—fully open-sourced with code, weights, and a 1.5M dataset!
⚠️ Why existing methods struggle: Standard approaches rely on a scene-aligned glyph image to specify both layout and character shape. Because glyph resolution is tied to region size, small text, dense multi-line layouts, and complex scripts get squeezed into a handful of pixels, resulting in missing, merged, or distorted strokes.
🧠 Our approach: GlyphAtlas decouples where text goes from how strokes are drawn. A scene-aligned glyph image anchors layout, while a resolution-independent glyph atlas—encoded directly via the backbone's native VAE without extra encoders—supplies crisp stroke references. Atlas-anchored attention then binds each cell back to its target region for accurate coarse-to-fine synthesis.
🌍 Zero-shot & Open Source: Trained solely on Chinese and English, GlyphAtlas-Bi generalizes zero-shot to Japanese, Korean, and Arabic, handling everything from curved storefronts and posters to dense book covers. Alongside our code and weights, we also release GlyphAtlas-Data-1.5M (1.5 million scene text images) to support the community!
🌐 Project page: https://fr0zencrane.github.io/project-glyphatlas/
🤗 Model checkpoint: https://huggingface.co/Fr0zencr4nE/GlyphAtlas
📚 Dataset: https://huggingface.co/datasets/Fr0zencr4nE/GlyphAtlas-Data-1.5M
💻 Code: https://github.com/Fr0zenCrane/GlyphAtlas
Try it out and let us know what you think, feedback and questions are very welcome! 🙌
來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co