English
Related papers

Related papers: Free-Form Image Inpainting with Gated Convolution

200 papers

Current Generative Adversarial Networks (GANs) produce photorealistic renderings of portrait images. Embedding real images into the latent space of such models enables high-level image editing. While recent methods provide considerable…

Graphics · Computer Science 2021-09-21 Thomas Leimkühler , George Drettakis

Image synthesis has witnessed substantial progress due to the increasing power of generative model. This paper we propose a novel generative approach for exemplar based facial editing in the form of the region inpainting. Our method first…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Jingtao Guo , Yi Liu , Zhenzhen Qian , Zuowei Zhou

Generative adversarial networks (GANs) can now generate photo-realistic images. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN internally conditioned on a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-10 Xingzhe He , Bastian Wandt , Helge Rhodin

Generative Adversarial Networks (GANs) are a powerful class of generative models. Despite their successes, the most appropriate choice of a GAN network architecture is still not well understood. GAN models for image synthesis have adopted a…

Machine Learning · Computer Science 2019-05-28 Sukarna Barua , Sarah Monazam Erfani , James Bailey

Current state-of-the-art methods for video inpainting typically rely on optical flow or attention-based approaches to inpaint masked regions by propagating visual information across frames. While such approaches have led to significant…

Despite remarkable advances in image synthesis research, existing works often fail in manipulating images under the context of large geometric transformations. Synthesizing person images conditioned on arbitrary poses is one of the most…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Haoye Dong , Xiaodan Liang , Ke Gong , Hanjiang Lai , Jia Zhu , Jian Yin

Diffusion probabilistic models learn to remove noise added during training, generating novel data (e.g., images) from Gaussian noise through sequential denoising. However, conditioning the generative process on corrupted or masked images is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Sakshi Agarwal , Gabriel Hope , Jimin Heo , Erik B. Sudderth

Color image inpainting is a challenging task in imaging science. The existing method is based on real operation, and the red, green and blue channels of the color image are processed separately, ignoring the correlation between each…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Duan Wang , Dandan Zhu , Meixiang Zhao , Zhigang Jia

Previous animatable 3D-aware GANs for human generation have primarily focused on either the human head or full body. However, head-only videos are relatively uncommon in real life, and full body generation typically does not deal with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yue Wu , Sicheng Xu , Jianfeng Xiang , Fangyun Wei , Qifeng Chen , Jiaolong Yang , Xin Tong

Existing GAN inversion and editing methods work well for aligned objects with a clean background, such as portraits and animal faces, but often struggle for more difficult categories with complex scene layouts and object occlusions, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Gaurav Parmar , Yijun Li , Jingwan Lu , Richard Zhang , Jun-Yan Zhu , Krishna Kumar Singh

Generative adversarial networks (GANs) have made great success in image inpainting yet still have difficulties tackling large missing regions. In contrast, iterative probabilistic algorithms, such as autoregressive and denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Wenbo Li , Xin Yu , Kun Zhou , Yibing Song , Zhe Lin , Jiaya Jia

How to efficiently utilize temporal information to recover videos in a consistent way is the main issue for video inpainting problems. Conventional 2D CNNs have achieved good performance on image inpainting but often lead to temporally…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Ya-Liang Chang , Zhe Yu Liu , Kuan-Ying Lee , Winston Hsu

This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative…

Optimization and Control · Mathematics 2021-11-10 Andreas Habring , Martin Holler

Generative Adversarial Networks (GANs) with style-based generators (e.g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

Generative adversarial networks (GANs), trained on a large-scale image dataset, can be a good approximator of the natural image manifold. GAN-inversion, using a pre-trained generator as a deep generative prior, is a promising tool for image…

Computer Vision and Pattern Recognition · Computer Science 2023-02-27 Shancong Mou , Xiaoyi Gu , Meng Cao , Haoping Bai , Ping Huang , Jiulong Shan , Jianjun Shi

In this paper, we focus on 3D scene inpainting, where parts of an input image set, captured from different viewpoints, are masked out. The main challenge lies in generating plausible image completions that are geometrically consistent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Ahmad Salimi , Tristan Aumentado-Armstrong , Marcus A. Brubaker , Konstantinos G. Derpanis

Facial composites are graphical representations of an eyewitness's memory of a face. Many digital systems are available for the creation of such composites but are either unable to reproduce features unless previously designed or do not…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Nicola Zaltron , Luisa Zurlo , Sebastian Risi

This paper tackles unpaired image enhancement, a task of learning a mapping function which transforms input images into enhanced images in the absence of input-output image pairs. Our method is based on generative adversarial networks…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Satoshi Kosugi , Toshihiko Yamasaki

Current generative frameworks use end-to-end learning and generate images by sampling from uniform noise distribution. However, these approaches ignore the most basic principle of image formation: images are product of: (a) Structure: the…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Xiaolong Wang , Abhinav Gupta

In this paper, we focus on image inpainting task, aiming at recovering the missing area of an incomplete image given the context information. Recent development in deep generative models enables an efficient end-to-end framework for image…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Yuhang Song , Chao Yang , Yeji Shen , Peng Wang , Qin Huang , C. -C. Jay Kuo