English
Related papers

Related papers: Text-Guided Neural Image Inpainting

200 papers

Image inpainting refers to the task of generating a complete, natural image based on a partially revealed reference image. Recently, many research interests have been focused on addressing this problem using fixed diffusion models. These…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Guanhua Zhang , Jiabao Ji , Yang Zhang , Mo Yu , Tommi Jaakkola , Shiyu Chang

Recent years have witnessed the success of large text-to-image diffusion models and their remarkable potential to generate high-quality images. The further pursuit of enhancing the editability of images has sparked significant interest in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Yifu Chen , Jingwen Chen , Yingwei Pan , Yehao Li , Ting Yao , Zhineng Chen , Tao Mei

Image inpainting is the task of filling masked or unknown regions of an image with visually realistic contents, which has been remarkably improved by Deep Neural Networks (DNNs) recently. Essentially, as an inverse problem, the inpainting…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Chenjie Cao , Chengrong Wang , Yuntao Zhang , Yanwei Fu

Deep learning (DL) has demonstrated its powerful capabilities in the field of image inpainting, which could produce visually plausible results. Meanwhile, the malicious use of advanced image inpainting tools (e.g. removing key objects to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Haiwei Wu , Jiantao Zhou

Generic image inpainting aims to complete a corrupted image by borrowing surrounding information, which barely generates novel content. By contrast, multi-modal inpainting provides more flexible and useful controls on the inpainted content,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Shaoan Xie , Zhifei Zhang , Zhe Lin , Tobias Hinz , Kun Zhang

Image inpainting is the task of filling in missing or masked region of an image with semantically meaningful contents. Recent methods have shown significant improvement in dealing with large-scale missing regions. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Wanglong Lu , Xianta Jiang , Xiaogang Jin , Yong-Liang Yang , Minglun Gong , Tao Wang , Kaijie Shi , Hanli Zhao

Video inpainting aims to fill spatio-temporal holes with plausible content in a video. Despite tremendous progress of deep neural networks for image inpainting, it is challenging to extend these methods to the video domain due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

Text-to-image (T2I) diffusion models, with their impressive generative capabilities, have been adopted for image editing tasks, demonstrating remarkable efficacy. However, due to attention leakage and collision between the cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Xingxi Yin , Zhi Li , Jingfeng Zhang , Chenglin Li , Yin Zhang

Patch-based methods and deep networks have been employed to tackle image inpainting problem, with their own strengths and weaknesses. Patch-based methods are capable of restoring a missing region with high-quality texture through searching…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rui Xu , Minghao Guo , Jiaqi Wang , Xiaoxiao Li , Bolei Zhou , Chen Change Loy

Deep convolutional networks (CNNs) have exhibited their potential in image inpainting for producing plausible results. However, in most existing methods, e.g., context encoder, the missing parts are predicted by propagating the surrounding…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Zhaoyi Yan , Xiaoming Li , Mu Li , Wangmeng Zuo , Shiguang Shan

Structure-guided image completion aims to inpaint a local region of an image according to an input guidance map from users. While such a task enables many practical applications for interactive editing, existing methods often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Haitian Zheng , Zhe Lin , Jingwan Lu , Scott Cohen , Eli Shechtman , Connelly Barnes , Jianming Zhang , Qing Liu , Yuqian Zhou , Sohrab Amirghodsi , Jiebo Luo

Recent image inpainting methods have shown promising results due to the power of deep learning, which can explore external information available from the large training dataset. However, many state-of-the-art inpainting networks are still…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Eunhye Lee , Jeongmu Kim , Jisu Kim , Tae Hyun Kim

Image inpainting, the process of restoring corrupted images, has seen significant advancements with the advent of diffusion models (DMs). Despite these advancements, current DM adaptations for inpainting, which involve modifications to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xuan Ju , Xian Liu , Xintao Wang , Yuxuan Bian , Ying Shan , Qiang Xu

Existing learning-based image inpainting methods are still in challenge when facing complex semantic environments and diverse hole patterns. The prior information learned from the large scale training data is still insufficient for these…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Taorong Liu , Liang Liao , Zheng Wang , Shin'ichi Satoh

Visual compatibility is critical for fashion analysis, yet is missing in existing fashion image synthesis systems. In this paper, we propose to explicitly model visual compatibility through fashion image inpainting. To this end, we present…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Xintong Han , Zuxuan Wu , Weilin Huang , Matthew R. Scott , Larry S. Davis

Recent image inpainting methods show promising results due to the power of deep learning, which can explore external information available from a large training dataset. However, many state-of-the-art inpainting networks are still limited…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Eunhye Lee , Jeongmu Kim , Jisu Kim , Tae Hyun Kim

Text-guided image editing can have a transformative impact in supporting creative applications. A key challenge is to generate edits that are faithful to input text prompts, while consistent with input images. We present Imagen Editor, a…

Deep image inpainting aims to restore damaged or missing regions in an image with realistic contents. While having a wide range of applications such as object removal and image recovery, deep inpainting techniques also have the risk of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Ang Li , Qiuhong Ke , Xingjun Ma , Haiqin Weng , Zhiyuan Zong , Feng Xue , Rui Zhang

In text-to-image diffusion models, the cross-attention map of each text token indicates the specific image regions attended. Comparing these maps of syntactically related tokens provides insights into how well the generated image reflects…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jeeyung Kim , Erfan Esmaeili , Qiang Qiu

The advent of deep learning in the past decade has significantly helped advance image inpainting. Although achieving promising performance, deep learning-based inpainting algorithms still struggle from the distortion caused by the fusion of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Kangdi Shi , Muhammad Alrabeiah , Jun Chen