English
Related papers

Related papers: Free-Form Image Inpainting with Gated Convolution

200 papers

Image inpainting is a valuable technique for enhancing images that have been corrupted. The primary challenge in this research revolves around the extent of corruption in the input image that the deep learning model must restore. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Mehrshad Momen-Tayefeh , Mehrdad Momen-Tayefeh , Amir Ali Ghafourian Ghahramani

We propose a system for surface completion and inpainting of 3D shapes using generative models, learnt on local patches. Our method uses a novel encoding of height map based local patches parameterized using 3D mesh quadrangulation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Kripasindhu Sarkar , Kiran Varanasi , Didier Stricker

Image inpainting is one of the most challenging tasks in computer vision. Recently, generative-based image inpainting methods have been shown to produce visually plausible images. However, they still have difficulties to generate the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 Mohamed Abbas Hedjazi , Yakup Genc

Image inpainting is the task of filling in missing or masked region of an image with semantically meaningful contents. Recent methods have shown significant improvement in dealing with large-scale missing regions. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Wanglong Lu , Xianta Jiang , Xiaogang Jin , Yong-Liang Yang , Minglun Gong , Tao Wang , Kaijie Shi , Hanli Zhao

Contemporary benchmark methods for image inpainting are based on deep generative models and specifically leverage adversarial loss for yielding realistic reconstructions. However, these models cannot be directly applied on image/video…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Avisek Lahiri , Arnav Jain , Prabir Kumar Biswas , Pabitra Mitra

We present a novel image editing system that generates images as the user provides free-form mask, sketch and color as an input. Our system consist of a end-to-end trainable convolutional network. Contrary to the existing methods, our…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Youngjoo Jo , Jongyoul Park

Portrait editing is a popular subject in photo manipulation. The Generative Adversarial Network (GAN) advances the generating of realistic faces and allows more face editing. In this paper, we argue about three issues in existing…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Shuyang Gu , Jianmin Bao , Hao Yang , Dong Chen , Fang Wen , Lu Yuan

Semantic image inpainting is a challenging task where large missing regions have to be filled based on the available visual data. Existing methods which extract information from only a single image generally produce unsatisfactory results…

Computer Vision and Pattern Recognition · Computer Science 2017-07-14 Raymond A. Yeh , Chen Chen , Teck Yian Lim , Alexander G. Schwing , Mark Hasegawa-Johnson , Minh N. Do

We present a model to reconstruct partially visible objects. The model takes a mask as an input, which we call weighted mask. The mask is utilized by gated convolutions to assign more weight to the visible pixels of the occluded instance…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Kaziwa Saleh , Sándor Szénási , Zoltán Vámossy

Existing deep learning based image inpainting methods use a standard convolutional network over the corrupted image, using convolutional filter responses conditioned on both valid pixels as well as the substitute values in the masked holes…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Guilin Liu , Fitsum A. Reda , Kevin J. Shih , Ting-Chun Wang , Andrew Tao , Bryan Catanzaro

Recent GAN-based (Generative adversarial networks) inpainting methods show remarkable improvements and generate plausible images using multi-stage networks or Contextual Attention Modules (CAM). However, these techniques increase the model…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Mohamed Abbas Hedjazi , Yakup Genc

Image inpainting is a widely used technique in computer vision for reconstructing missing or damaged pixels in images. Recent advancements with Generative Adversarial Networks (GANs) have demonstrated superior performance over traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Nafiz Al Asad , Md. Appel Mahmud Pranto , Shbiruzzaman Shiam , Musaddeq Mahmud Akand , Mohammad Abu Yousuf , Khondokar Fida Hasan , Mohammad Ali Moni

Semantic inpainting or image completion alludes to the task of inferring arbitrary large missing regions in images based on image semantics. Since the prediction of image pixels requires an indication of high-level context, this makes it…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Priyansh Saxena , Raahat Gupta , Akshat Maheshwari , Saumil Maheshwari

Free-form inpainting is the task of adding new content to an image in the regions specified by an arbitrary binary mask. Most existing approaches train for a certain distribution of masks, which limits their generalization capabilities to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Andreas Lugmayr , Martin Danelljan , Andres Romero , Fisher Yu , Radu Timofte , Luc Van Gool

Nowadays, the need for user editing in a 3D scene has rapidly increased due to the development of AR and VR technology. However, the existing 3D scene completion task (and datasets) cannot suit the need because the missing regions in scenes…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Ru-Fen Jheng , Tsung-Han Wu , Jia-Fong Yeh , Winston H. Hsu

Image inpainting is a non-trivial task in computer vision due to multiple possibilities for filling the missing data, which may be dependent on the global information of the image. Most of the existing approaches use the attention mechanism…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 Gourav Wadhwa , Abhinav Dhall , Subrahmanyam Murala , Usman Tariq

A regular convolution layer applying a filter in the same way over known and unknown areas causes visual artifacts in the inpainted image. Several studies address this issue with feature re-normalization on the output of the convolution.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Håkon Hukkelås , Frank Lindseth , Rudolf Mester

This study introduces a novel method for inpainting normal maps using a generative adversarial network (GAN). Normal maps, often derived from a lightstage, are crucial in performance capture but can have obscured areas due to movement…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Hancheng Zuo , Bernard Tiddeman

In recent years, there has been a significant focus on research related to text-guided image inpainting. However, the task remains challenging due to several constraints, such as ensuring alignment between the image and the text, and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Jihoon Lee , Yunhong Min , Hwidong Kim , Sangtae Ahn

Recovering badly damaged face images is a useful yet challenging task, especially in extreme cases where the masked or damaged region is very large. One of the major challenges is the ability of the system to generalize on faces outside the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Nilesh Pandey , Andreas Savakis