English
Related papers

Related papers: DreamInpainter: Text-Guided Subject-Driven Image I…

200 papers

Recent text-to-image generation models like DreamBooth have made remarkable progress in generating highly customized images of a target subject, by fine-tuning an ``expert model'' for a given subject from a few examples. However, this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Wenhu Chen , Hexiang Hu , Yandong Li , Nataniel Ruiz , Xuhui Jia , Ming-Wei Chang , William W. Cohen

We present the first text-based image editing approach for object parts based on pre-trained diffusion models. Diffusion-based image editing approaches capitalized on the deep understanding of diffusion models of image semantics to perform…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aleksandar Cvejic , Abdelrahman Eldesokey , Peter Wonka

Text-driven diffusion models have significantly advanced the image editing performance by using text prompts as inputs. One crucial step in text-driven image editing is to invert the original image into a latent noise code conditioned on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Ruibin Li , Ruihuang Li , Song Guo , Lei Zhang

Image inpainting methods have shown significant improvements by using deep neural networks recently. However, many of these techniques often create distorted structures or blurry textures inconsistent with surrounding areas. The problem is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Maitreya Suin , Kuldeep Purohit , A. N. Rajagopalan

Text-to-image diffusion models produce impressive results but are frustrating tools for artists who desire fine-grained control. For example, a common use case is to create images of a specific instance in novel contexts, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Shengqu Cai , Eric Chan , Yunzhi Zhang , Leonidas Guibas , Jiajun Wu , Gordon Wetzstein

Images can be viewed as layered compositions, foreground objects over background, with potential occlusions. This layered representation enables independent editing of elements, offering greater flexibility for content creation. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jingxi Chen , Yixiao Zhang , Xiaoye Qian , Zongxia Li , Cornelia Fermuller , Caren Chen , Yiannis Aloimonos

Generating images with embedded text is crucial for the automatic production of visual and multimodal documents, such as educational materials and advertisements. However, existing diffusion-based text-to-image models often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Forouzan Fallah , Maitreya Patel , Agneet Chatterjee , Vlad I. Morariu , Chitta Baral , Yezhou Yang

Text-to-image diffusion models have an unprecedented ability to generate diverse and high-quality images. However, they often struggle to faithfully capture the intended semantics of complex input prompts that include multiple subjects.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Omer Dahary , Or Patashnik , Kfir Aberman , Daniel Cohen-Or

Despite promising progress in face swapping task, realistic swapped images remain elusive, often marred by artifacts, particularly in scenarios involving high pose variation, color differences, and occlusion. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Sanoojan Baliah , Qinliang Lin , Shengcai Liao , Xiaodan Liang , Muhammad Haris Khan

This paper addresses an important problem of object addition for images with only text guidance. It is challenging because the new object must be integrated seamlessly into the image with consistent visual context, such as lighting,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Lirui Zhao , Tianshuo Yang , Wenqi Shao , Yuxin Zhang , Yu Qiao , Ping Luo , Kaipeng Zhang , Rongrong Ji

Current image stitching methods often produce noticeable seams in challenging scenarios such as uneven hue and large parallax. To tackle this problem, we propose the Reference-Driven Inpainting Stitcher (RDIStitcher), which reformulates the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Ziqi Xie , Xiao Lai , Weidong Zhao , Siqi Jiang , Xianhui Liu , Wenlong Hou

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

Diffusion-based inpainting can reconstruct missing image areas with high quality from sparse data, provided that their location and their values are well optimised. This is particularly useful for applications such as image compression,…

Image and Video Processing · Electrical Eng. & Systems 2023-03-24 Pascal Peter , Karl Schrader , Tobias Alt , Joachim Weickert

Diffusion-based generative models have revolutionized object-oriented image editing, yet their deployment in realistic object removal and insertion remains hampered by challenges such as the intricate interplay of physical effects and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yongsheng Yu , Ziyun Zeng , Haitian Zheng , Jiebo Luo

Large text-to-image models have revolutionized the ability to generate imagery using natural language. However, particularly unique or personal visual concepts, such as pets and furniture, will not be captured by the original model. This…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xingzhe He , Zhiwen Cao , Nicholas Kolkin , Lantao Yu , Kun Wan , Helge Rhodin , Ratheesh Kalarot

Text-guided image-to-image diffusion models excel in translating images based on textual prompts, allowing for precise and creative visual modifications. However, such a powerful technique can be misused for spreading misinformation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wenhao Wang , Yifan Sun , Zongxin Yang , Zhentao Tan , Zhengdong Hu , Yi Yang

Deep generative models have shown success in automatically synthesizing missing image regions using surrounding context. However, users cannot directly decide what content to synthesize with such approaches. We propose an end-to-end network…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Yinan Zhao , Brian Price , Scott Cohen , Danna Gurari

Text-guided image manipulation has experienced notable advancement in recent years. In order to mitigate linguistic ambiguity, few-shot learning with visual examples has been applied for instructions that are underrepresented in the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Bolin Lai , Felix Juefei-Xu , Miao Liu , Xiaoliang Dai , Nikhil Mehta , Chenguang Zhu , Zeyi Huang , James M. Rehg , Sangmin Lee , Ning Zhang , Tong Xiao

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

Image inpainting is a technique of completing missing pixels such as occluded region restoration, distracting objects removal, and facial completion. Among these inpainting tasks, facial completion algorithm performs face inpainting…

Computer Vision and Pattern Recognition · Computer Science 2023-01-20 Dongsik Yoon , Jeonggi Kwak , Yuanming Li , David Han , Youngsaeng Jin , Hanseok Ko