English
Related papers

Related papers: Free-Form Image Inpainting with Gated Convolution

200 papers

This work introduces a novel system for the generation of images that contain multiple classes of objects. Recent work in Generative Adversarial Networks have produced high quality images, but many focus on generating images of a single…

Machine Learning · Computer Science 2019-11-11 Elijah D. Bolluyt , Cristina Comaniciu

Visual surface inspection is a challenging task owing to the highly diverse appearance of target surfaces and defective regions. Previous attempts heavily rely on vast quantities of training examples with manual annotation. However, in some…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Lingyun Gu , Lin Zhang , Zhaokui Wang

3D-aware GANs offer new capabilities for view synthesis while preserving the editing functionalities of their 2D counterparts. GAN inversion is a crucial step that seeks the latent code to reconstruct input images or videos, subsequently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yiran Xu , Zhixin Shu , Cameron Smith , Seoung Wug Oh , Jia-Bin Huang

We propose PD-GAN, a probabilistic diverse GAN for image inpainting. Given an input image with arbitrary hole regions, PD-GAN produces multiple inpainting results with diverse and visually realistic content. Our PD-GAN is built upon a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Hongyu Liu , Ziyu Wan , Wei Huang , Yibing Song , Xintong Han , Jing Liao

In this paper we present several architectural and optimization recipes for generative adversarial network(GAN) based facial semantic inpainting. Current benchmark models are susceptible to initial solutions of non-convex optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Avisek Lahiri , Arnav Jain , Divyasri Nadendla , Prabir Kumar Biswas

Depth completion is a critical task for handling depth images with missing pixels, which can negatively impact further applications. Recent approaches have utilized Convolutional Neural Networks (CNNs) to reconstruct depth images with the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Tingxuan Huang , Jiacheng Miao , Shizhuo Deng , Tong , Dongyue Chen

Most convolutional network (CNN)-based inpainting methods adopt standard convolution to indistinguishably treat valid pixels and holes, making them limited in handling irregular holes and more likely to generate inpainting results with…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Chaohao Xie , Shaohui Liu , Chao Li , Ming-Ming Cheng , Wangmeng Zuo , Xiao Liu , Shilei Wen , Errui Ding

Region-adaptive normalization (RAN) methods have been widely used in the generative adversarial network (GAN)-based image-to-image translation technique. However, since these approaches need a mask image to infer the pixel-wise affine…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Yoon-Jae Yeo , Min-Cheol Sagong , Seung Park , Sung-Jea Ko , Yong-Goo Shin

Language guided image inpainting aims to fill in the defective regions of an image under the guidance of text while keeping non-defective regions unchanged. However, the encoding process of existing models suffers from either receptive…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Minheng Ni , Chenfei Wu , Haoyang Huang , Daxin Jiang , Wangmeng Zuo , Nan Duan

Seamlessly blending features from multiple images is extremely challenging because of complex relationships in lighting, geometry, and partial occlusion which cause coupling between different parts of the image. Even though recent work on…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Peihao Zhu , Rameen Abdal , John Femiani , Peter Wonka

Although significant progress has been made in synthesizing high-quality and visually realistic face images by unconditional Generative Adversarial Networks (GANs), there still lacks of control over the generation process in order to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Xianxu Hou , Xiaokang Zhang , Linlin Shen , Zhihui Lai , Jun Wan

We present a novel approach to image manipulation and understanding by simultaneously learning to segment object masks, paste objects to another background image, and remove them from original images. For this purpose, we develop a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Pavel Ostyakov , Roman Suvorov , Elizaveta Logacheva , Oleg Khomenko , Sergey I. Nikolenko

Over the last decade, the process of automatic image colorization has been of significant interest for several application areas including restoration of aged or degraded images. This problem is highly ill-posed due to the large degrees of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Kamyar Nazeri , Eric Ng , Mehran Ebrahimi

Inpainting arbitrary missing regions is challenging because learning valid features for various masked regions is nontrivial. Though U-shaped encoder-decoder frameworks have been witnessed to be successful, most of them share a common…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Manyu Zhu , Dongliang He , Xin Li , Chao Li , Fu Li , Xiao Liu , Errui Ding , Zhaoxiang Zhang

Existing 3D-aware facial generation methods face a dilemma in quality versus editability: they either generate editable results in low resolution or high-quality ones with no editing flexibility. In this work, we propose a new approach that…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Jingxiang Sun , Xuan Wang , Yichun Shi , Lizhen Wang , Jue Wang , Yebin Liu

Deep generative models have shown success in automatically synthesizing missing image regions using surrounding context. However, users cannot directly decide what content to synthesize with such approaches. We propose an end-to-end network…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Yinan Zhao , Brian Price , Scott Cohen , Danna Gurari

We examined the use of modern Generative Adversarial Nets to generate novel images of oil paintings using the Painter By Numbers dataset. We implemented Spectral Normalization GAN (SN-GAN) and Spectral Normalization GAN with Gradient…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Adeel Mufti , Biagio Antonelli , Julius Monello

We propose a unified Generative Adversarial Network (GAN) for controllable image-to-image translation, i.e., transferring an image from a source to a target domain guided by controllable structures. In addition to conditioning on a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Hao Tang , Hong Liu , Nicu Sebe

Nerf-based Generative models have shown impressive capacity in generating high-quality images with consistent 3D geometry. Despite successful synthesis of fake identity images randomly sampled from latent space, adopting these models for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yu Yin , Kamran Ghasedi , HsiangTao Wu , Jiaolong Yang , Xin Tong , Yun Fu

Deep generative approaches have recently made considerable progress in image inpainting by introducing structure priors. Due to the lack of proper interaction with image texture during structure reconstruction, however, current solutions…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Xiefan Guo , Hongyu Yang , Di Huang