English
Related papers

Related papers: TextMastero: Mastering High-Quality Scene Text Edi…

200 papers

Texture map production is an important part of 3D modeling and determines the rendering quality. Recently, diffusion-based methods have opened a new way for texture generation. However, restricted control flexibility and limited prompt…

Graphics · Computer Science 2025-06-04 Dongyu Yan , Leyi Wu , Jiantao Lin , Luozhou Wang , Tianshuo Xu , Zhifei Chen , Zhen Yang , Lie Xu , Shunsi Zhang , Yingcong Chen

Text-conditioned image editing has greatly benefitted from the advancements in Image Diffusion Models. However, extending these techniques to facial video editing introduces challenges in preserving facial identity throughout the source…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Huanghao Yin , Shenkun Xu , Kanle Shi , Junhai Yong , Bin Wang

Large-scale text-to-image generative models have been a ground-breaking development in generative AI, with diffusion models showing their astounding ability to synthesize convincing images following an input text prompt. The goal of image…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Kai Wang , Fei Yang , Shiqi Yang , Muhammad Atif Butt , Joost van de Weijer

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Large-scale text-to-image (T2I) diffusion models excel at open-domain synthesis but still struggle with precise text rendering, especially for multi-line layouts, dense typography, and long-tailed scripts such as Chinese. Prior solutions…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Ruiqiang Zhang , Hengyi Wang , Chang Liu , Guanjie Wang , Zehua Ma , Weiming Zhang

Conditional diffusion models have demonstrated impressive performance on various tasks like text-guided semantic image editing. Prior work requires image regions to be identified manually by human users or use an object detector that only…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Zhongping Zhang , Huiwen He , Bryan A. Plummer , Zhenyu Liao , Huayan Wang

Facial attribute editing and style manipulation are crucial for applications like virtual avatars and photo editing. However, achieving precise control over facial attributes without altering unrelated features is challenging due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Wenmin Huang , Weiqi Luo , Xiaochun Cao , Jiwu Huang

Diffusion models (DMs) can generate realistic images with text guidance using large-scale datasets. However, they demonstrate limited controllability in the output space of the generated images. We propose a novel learning method for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Rumeysa Bodur , Erhan Gundogdu , Binod Bhattarai , Tae-Kyun Kim , Michael Donoser , Loris Bazzani

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

Instruction-based image editing enables precise modifications via natural language prompts, but existing methods face a precision-efficiency tradeoff: fine-tuning demands massive datasets (>10M) and computational resources, while…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zechuan Zhang , Ji Xie , Yu Lu , Zongxin Yang , Yi Yang

Text-based semantic image editing assumes the manipulation of an image using a natural language instruction. Although recent works are capable of generating creative and qualitative images, the problem is still mostly approached as a black…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Maria Mihaela Trusca , Tinne Tuytelaars , Marie-Francine Moens

In this paper, we propose Text2Scene, a model that generates various forms of compositional scene representations from natural language descriptions. Unlike recent works, our method does NOT use Generative Adversarial Networks (GANs).…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Fuwen Tan , Song Feng , Vicente Ordonez

Synthesizing interactive 3D scenes from text is essential for gaming, virtual reality, and embodied AI. However, existing methods face several challenges. Learning-based approaches depend on small-scale indoor datasets, limiting the scene…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Lu Ling , Chen-Hsuan Lin , Tsung-Yi Lin , Yifan Ding , Yu Zeng , Yichen Sheng , Yunhao Ge , Ming-Yu Liu , Aniket Bera , Zhaoshuo Li

Current text recognition systems, including those for handwritten scripts and scene text, have relied heavily on image synthesis and augmentation, since it is difficult to realize real-world complexity and diversity through collecting and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yuanzhi Zhu , Zhaohai Li , Tianwei Wang , Mengchao He , Cong Yao

A plethora of text-guided image editing methods has recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models especially Stable Diffusion. Despite the success of diffusion models in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Qihe Pan , Zhen Zhao , Zicheng Wang , Sifan Long , Yiming Wu , Wei Ji , Haoran Liang , Ronghua Liang

In the current era of generative AI breakthroughs, generating panoramic scenes from a single input image remains a key challenge. Most existing methods use diffusion-based iterative or simultaneous multi-view inpainting. However, the lack…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Zhipeng Cai , Matthias Mueller , Reiner Birkl , Diana Wofk , Shao-Yen Tseng , JunDa Cheng , Gabriela Ben-Melech Stan , Vasudev Lal , Michael Paulitsch

Diffusion models have achieved remarkable advancements in text-to-image generation. However, existing models still have many difficulties when faced with multiple-object compositional generation. In this paper, we propose RealCompo, a new…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xinchen Zhang , Ling Yang , Yaqi Cai , Zhaochen Yu , Kai-Ni Wang , Jiake Xie , Ye Tian , Minkai Xu , Yong Tang , Yujiu Yang , Bin Cui

Diffusion-based methods have achieved remarkable achievements in 2D image or 3D object generation, however, the generation of 3D scenes and even $360^{\circ}$ images remains constrained, due to the limited number of scene datasets, the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Weicai Ye , Chenhao Ji , Zheng Chen , Junyao Gao , Xiaoshui Huang , Song-Hai Zhang , Wanli Ouyang , Tong He , Cairong Zhao , Guofeng Zhang

Generating an image from a given text description has two goals: visual realism and semantic consistency. Although significant progress has been made in generating high-quality and visually realistic images using generative adversarial…

Computation and Language · Computer Science 2019-03-15 Tingting Qiao , Jing Zhang , Duanqing Xu , Dacheng Tao

Artistic text style transfer is the task of migrating the style from a source image to the target text to create artistic typography. Recent style transfer methods have considered texture control to enhance usability. However, controlling…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Shuai Yang , Zhangyang Wang , Zhaowen Wang , Ning Xu , Jiaying Liu , Zongming Guo