English
Related papers

Related papers: Unbiased Multi-Modality Guidance for Image Inpaint…

200 papers

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ximeng Sun , Ryan Szeto , Jason J. Corso

In recent years, diffusion models have been widely adopted for image inpainting tasks due to their powerful generative capabilities, achieving impressive results. Existing multimodal inpainting methods based on diffusion models often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Qimin Wang , Xinda Liu , Guohua Geng

Existing image inpainting methods typically fill holes by borrowing information from surrounding pixels. They often produce unsatisfactory results when the holes overlap with or touch foreground objects due to lack of information about the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Wei Xiong , Jiahui Yu , Zhe Lin , Jimei Yang , Xin Lu , Connelly Barnes , Jiebo Luo

Amodal segmentation aims to predict segmentation masks for both the visible and occluded regions of an object. Most existing works formulate this as a supervised learning problem, requiring manually annotated amodal masks or synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jae Joong Lee , Bedrich Benes , Raymond A. Yeh

Deep generative models have shown success in automatically synthesizing missing image regions using surrounding context. However, users cannot directly decide what content to synthesize with such approaches. We propose an end-to-end network…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Yinan Zhao , Brian Price , Scott Cohen , Danna Gurari

Image outpainting technology generates visually plausible content regardless of authenticity, making it unreliable to be applied in practice. Thus, we propose a reliable image outpainting task, introducing the sparse depth from LiDARs to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Lei Zhang , Kang Liao , Chunyu Lin , Yao Zhao

Manipulating images of complex scenes to reconstruct, insert and/or remove specific object instances is a challenging task. Complex scenes contain multiple semantics and objects, which are frequently cluttered or ambiguous, thus hampering…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Pierfrancesco Ardino , Yahui Liu , Elisa Ricci , Bruno Lepri , Marco De Nadai

This paper develops a multi-task learning framework that attempts to incorporate the image structure knowledge to assist image inpainting, which is not well explored in previous works. The primary idea is to train a shared generator to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Jie Yang , Zhiquan Qi , Yong Shi

Blind inpainting is a task to automatically complete visual contents without specifying masks for missing areas in an image. Previous works assume missing region patterns are known, limiting its application scope. In this paper, we relax…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Yi Wang , Ying-Cong Chen , Xin Tao , Jiaya Jia

Image inpainting is an underdetermined inverse problem, which naturally allows diverse contents to fill up the missing or corrupted regions realistically. Prevalent approaches using convolutional neural networks (CNNs) can synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Yingchen Yu , Fangneng Zhan , Rongliang Wu , Jianxiong Pan , Kaiwen Cui , Shijian Lu , Feiying Ma , Xuansong Xie , Chunyan Miao

Image inpainting is the task of reconstructing missing or damaged parts of an image in a way that seamlessly blends with the surrounding content. With the advent of advanced generative models, especially diffusion models and generative…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Xingzhong Hou , Jie Wu , Boxiao Liu , Yi Zhang , Guanglu Song , Yunpeng Liu , Yu Liu , Haihang You

Image inpainting aims at restoring missing region of corrupted images, which has many applications such as image restoration and object removal. However, current GAN-based inpainting models fail to explicitly consider the semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Ang Li , Jianzhong Qi , Rui Zhang , Ramamohanarao Kotagiri

Image inpainting has achieved remarkable progress and inspired abundant methods, where the critical bottleneck is identified as how to fulfill the high-frequency structure and low-frequency texture information on the masked regions with…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Haipeng Liu , Yang Wang , Meng Wang , Yong Rui

Recent video inpainting methods have made remarkable progress by utilizing explicit guidance, such as optical flow, to propagate cross-frame pixels. However, there are cases where cross-frame recurrence of the masked video is not available,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Yongsheng Yu , Heng Fan , Libo Zhang

Image inpainting, the process of restoring missing or corrupted regions of an image by reconstructing pixel information, has recently seen considerable advancements through deep learning-based approaches. In this paper, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Kourosh Kiani , Razieh Rastgoo , Alireza Chaji , Sergio Escalera

We study the task of image inpainting, which is to fill in the missing region of an incomplete image with plausible contents. To this end, we propose a learning-based approach to generate visually coherent completion given a high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yuhang Song , Chao Yang , Zhe Lin , Xiaofeng Liu , Qin Huang , Hao Li , C. -C. Jay Kuo

This paper examines the limitations of advanced text-to-image models in accurately rendering unconventional concepts which are scarcely represented or absent in their training datasets. We identify how these limitations not only confine the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Jiyoon Myung , Jihyeon Park

Image inpainting is currently a hot topic within the field of computer vision. It offers a viable solution for various applications, including photographic restoration, video editing, and medical imaging. Deep learning advancements, notably…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Omar Elharrouss , Rafat Damseh , Abdelkader Nasreddine Belkacem , Elarbi Badidi , Abderrahmane Lakas

Many recent inpainting works have achieved impressive results by leveraging Deep Neural Networks (DNNs) to model various prior information for image restoration. Unfortunately, the performance of these methods is largely limited by the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Chenjie Cao , Qiaole Dong , Yanwei Fu

Medical images often incorporate doctor-added markers that can hinder AI-based diagnosis. This issue highlights the need of inpainting techniques to restore the corrupted visual contents. However, existing methods require manual mask…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Xuechen Guo , Wenhao Hu , Chiming Ni , Wenhao Chai , Shiyan Li , Gaoang Wang