English
Related papers

Related papers: Diverse Inpainting and Editing with GAN Inversion

200 papers

We resolve the ill-posed alpha matting problem from a completely different perspective. Given an input portrait image, instead of estimating the corresponding alpha matte, we focus on the other end, to subtly enhance this input so that the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Yangyang Xu Zeyang Zhou , Shengfeng He

Recently deep neutral networks have achieved promising performance for filling large missing regions in image inpainting tasks. They usually adopted the standard convolutional architecture over the corrupted image, leading to meaningless…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Yuqing Ma , Xianglong Liu , Shihao Bai , Lei Wang , Aishan Liu , Dacheng Tao , Edwin Hancock

The latest methods based on deep learning have achieved amazing results regarding the complex work of inpainting large missing areas in an image. But this type of method generally attempts to generate one single "optimal" result, ignoring…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Weiwei Cai , Zhanguo Wei

While the quality of GAN image synthesis has improved tremendously in recent years, our ability to control and condition the output is still limited. Focusing on StyleGAN, we introduce a simple and effective method for making local,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Edo Collins , Raja Bala , Bob Price , Sabine Süsstrunk

Generative adversarial networks (GANs) synthesize realistic images from a random latent vector. While many studies have explored various training configurations and architectures for GANs, the problem of inverting a generative model to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Nicky Bayat , Vahid Reza Khazaie , Yalda Mohsenzadeh

2D images are observations of the 3D physical world depicted with the geometry, material, and illumination components. Recovering these underlying intrinsic components from 2D images, also known as inverse rendering, usually requires a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Xingang Pan , Ayush Tewari , Lingjie Liu , Christian Theobalt

Contemporary benchmark methods for image inpainting are based on deep generative models and specifically leverage adversarial loss for yielding realistic reconstructions. However, these models cannot be directly applied on image/video…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Avisek Lahiri , Arnav Jain , Prabir Kumar Biswas , Pabitra Mitra

Although image inpainting, or the art of repairing the old and deteriorated images, has been around for many years, it has gained even more popularity because of the recent development in image processing techniques. With the improvement of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Omar Elharrouss , Noor Almaadeed , Somaya Al-Maadeed , Younes Akbari

The increasingly photorealistic sample quality of generative image models suggests their feasibility in applications beyond image generation. We present the Neural Photo Editor, an interface that leverages the power of generative neural…

Machine Learning · Computer Science 2017-02-07 Andrew Brock , Theodore Lim , J. M. Ritchie , Nick Weston

While Generative Adversarial Networks (GANs) have recently found applications in image editing, most previous GAN-based image editing methods require largescale datasets with semantic segmentation annotations for training, only provide high…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yuhan Cao , Haoran Jiang , Zhenghong Yu , Qi Li , Xuyang Li

While high fidelity and efficiency are central to the creation of digital head avatars, recent methods relying on 2D or 3D generative models often experience limitations such as shape distortion, expression inaccuracy, and identity…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaochen Zhao , Jingxiang Sun , Lizhen Wang , Jinli Suo , Yebin Liu

We propose VecGAN, an image-to-image translation framework for facial attribute editing with interpretable latent directions. Facial attribute editing task faces the challenges of precise attribute editing with controllable strength and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Yusuf Dalva , Said Fahri Altindis , Aysegul Dundar

3D-aware GANs offer new capabilities for view synthesis while preserving the editing functionalities of their 2D counterparts. GAN inversion is a crucial step that seeks the latent code to reconstruct input images or videos, subsequently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yiran Xu , Zhixin Shu , Cameron Smith , Seoung Wug Oh , Jia-Bin Huang

Denoising diffusion probabilistic models (DDPMs) employ a sequence of white Gaussian noise samples to generate an image. In analogy with GANs, those noise maps could be considered as the latent code associated with the generated image.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Inbar Huberman-Spiegelglas , Vladimir Kulikov , Tomer Michaeli

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

Image inpainting aims at restoring missing regions of corrupted images, which has many applications such as image restoration and object removal. However, current GAN-based generative inpainting models do not explicitly exploit the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Ang Li , Jianzhong Qi , Rui Zhang , Xingjun Ma , Kotagiri Ramamohanarao

Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

Recent advanced GAN inversion models aim to convey high-fidelity information from original images to generators through methods using generator tuning or high-dimensional feature learning. Despite these efforts, accurately reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Chaewon Kim , Seung-Jun Moon , Gyeong-Moon Park

Current Generative Adversarial Networks (GANs) produce photorealistic renderings of portrait images. Embedding real images into the latent space of such models enables high-level image editing. While recent methods provide considerable…

Graphics · Computer Science 2021-09-21 Thomas Leimkühler , George Drettakis

Generative Adversarial Networks (GANs) have made great success in synthesizing high-quality images. However, how to steer the generation process of a well-trained GAN model and customize the output image is much less explored. It has been…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Chen Zhang , Yinghao Xu , Yujun Shen