English
Related papers

Related papers: Text-Guided Neural Image Inpainting

200 papers

Depth completion is a crucial task in autonomous driving, aiming to convert a sparse depth map into a dense depth prediction. Due to its potentially rich semantic information, RGB image is commonly fused to enhance the completion effect.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Moyun Liu , Bing Chen , Youping Chen , Jingming Xie , Lei Yao , Yang Zhang , Joey Tianyi Zhou

Video inpainting aims to fill in corrupted regions of the video with plausible contents. Existing methods generally assume that the locations of corrupted regions are known, focusing primarily on the "how to inpaint". This reliance…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Zhiliang Wu , Kerui Chen , Kun Li , Hehe Fan , Yi Yang

The latest deep learning-based approaches have shown promising results for the challenging task of inpainting missing regions of an image. However, the existing methods often generate contents with blurry textures and distorted structures…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Hongyu Liu , Bin Jiang , Yi Xiao , Chao Yang

Most existing methods for image inpainting focus on learning the intra-image priors from the known regions of the current input image to infer the content of the corrupted regions in the same image. While such methods perform well on images…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Xin Feng , Wenjie Pei , Fengjun Li , Fanglin Chen , David Zhang , Guangming Lu

Image and video inpainting is a classic problem in computer vision and computer graphics, aiming to fill in the plausible and realistic content in the missing areas of images and videos. With the advance of deep learning, this problem has…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Weize Quan , Jiaxi Chen , Yanli Liu , Dong-Ming Yan , Peter Wonka

Image inpainting for completing complicated semantic environments and diverse hole patterns of corrupted images is challenging even for state-of-the-art learning-based inpainting methods trained on large-scale data. A reference image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Taorong Liu , Liang Liao , Delin Chen , Jing Xiao , Zheng Wang , Chia-Wen Lin , Shin'ichi Satoh

Image guided depth completion is the task of generating a dense depth map from a sparse depth map and a high quality image. In this task, how to fuse the color and depth modalities plays an important role in achieving good performance. This…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Mu Hu , Shuling Wang , Bin Li , Shiyu Ning , Li Fan , Xiaojin Gong

Contemporary benchmark methods for image inpainting are based on deep generative models and specifically leverage adversarial loss for yielding realistic reconstructions. However, these models cannot be directly applied on image/video…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Avisek Lahiri , Arnav Jain , Prabir Kumar Biswas , Pabitra Mitra

Recent advances in text-guided image compression have shown great potential to enhance the perceptual quality of reconstructed images. These methods, however, tend to have significantly degraded pixel-wise fidelity, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hagyeong Lee , Minkyu Kim , Jun-Hyuk Kim , Seungeon Kim , Dokwan Oh , Jaeho Lee

Image inpainting is a non-trivial task in computer vision due to multiple possibilities for filling the missing data, which may be dependent on the global information of the image. Most of the existing approaches use the attention mechanism…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 Gourav Wadhwa , Abhinav Dhall , Subrahmanyam Murala , Usman Tariq

This paper examines the limitations of advanced text-to-image models in accurately rendering unconventional concepts which are scarcely represented or absent in their training datasets. We identify how these limitations not only confine the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Jiyoon Myung , Jihyeon Park

Existing deep learning-based image inpainting methods typically rely on convolutional networks with RGB images to reconstruct images. However, relying exclusively on RGB images may neglect important depth information, which plays a critical…

Image and Video Processing · Electrical Eng. & Systems 2025-05-09 Jin Hyun Park , Harine Choi , Praewa Pitiphat

Video inpainting, which aims at filling in missing regions of a video, remains challenging due to the difficulty of preserving the precise spatial and temporal coherence of video contents. In this work we propose a novel flow-guided video…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Rui Xu , Xiaoxiao Li , Bolei Zhou , Chen Change Loy

Image inpainting is the task of plausibly restoring missing pixels within a hole region that is to be removed from a target image. Most existing technologies exploit patch similarities within the image, or leverage large-scale training data…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yuqian Zhou , Connelly Barnes , Eli Shechtman , Sohrab Amirghodsi

We introduce a new system for automatic image content removal and inpainting. Unlike traditional inpainting algorithms, which require advance knowledge of the region to be filled in, our system automatically detects the area to be removed…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Siyang Qin , Jiahui Wei , Roberto Manduchi

Recent progress in text-guided image inpainting, based on the unprecedented success of text-to-image diffusion models, has led to exceptionally realistic and visually plausible results. However, there is still significant potential for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hayk Manukyan , Andranik Sargsyan , Barsegh Atanyan , Zhangyang Wang , Shant Navasardyan , Humphrey Shi

Image inpainting, the process of filling in missing areas in an image, is a common image editing technique. Inpainting can be used to conceal or alter image contents in malicious manipulation of images, driving the need for research in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Ye Yao , Tingfeng Han , Shan Jia , Siwei Lyu

Over the last few years, deep learning techniques have yielded significant improvements in image inpainting. However, many of these techniques fail to reconstruct reasonable structures as they are commonly over-smoothed and/or blurry. This…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Kamyar Nazeri , Eric Ng , Tony Joseph , Faisal Z. Qureshi , Mehran Ebrahimi

Recently, diffusion models have exhibited superior performance in the area of image inpainting. Inpainting methods based on diffusion models can usually generate realistic, high-quality image content for masked areas. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ruichen Wang , Junliang Zhang , Qingsong Xie , Chen Chen , Haonan Lu

Humans can easily imagine a scene from auditory information based on their prior knowledge of audio-visual events. In this paper, we mimic this innate human ability in deep learning models to improve the quality of video inpainting. To…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-12 Kyuyeon Kim , Junsik Jung , Woo Jae Kim , Sung-Eui Yoon