English
Related papers

Related papers: Surrogate Gradient Field for Latent Space Manipula…

200 papers

This paper addresses the problem of manipulating images using natural language description. Our task aims to semantically modify visual attributes of an object in an image according to the text describing the new visual appearance. Although…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Seonghyeon Nam , Yunji Kim , Seon Joo Kim

With great progress in the development of Generative Adversarial Networks (GANs), in recent years, the quest for insights in understanding and manipulating the latent space of GAN has gained more and more attention due to its wide range of…

Machine Learning · Computer Science 2021-02-25 Toan Pham Van , Tam Minh Nguyen , Ngoc N. Tran , Hoai Viet Nguyen , Linh Bao Doan , Huy Quang Dao , Thanh Ta Minh

Existing generative adversarial network (GAN) based conditional image generative models typically produce fixed output for the same conditional input, which is unreasonable for highly subjective tasks, such as large-mask image inpainting or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Tianyi Chu , Wei Xing , Jiafu Chen , Zhizhong Wang , Jiakai Sun , Lei Zhao , Haibo Chen , Huaizhong Lin

Despite the success of Generative Adversarial Networks (GANs) in image synthesis, applying trained GAN models to real image processing remains challenging. Previous methods typically invert a target image back to the latent space either by…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Jinjin Gu , Yujun Shen , Bolei Zhou

Generative adversarial network (GAN) has greatly improved the quality of unsupervised image generation. Previous GAN-based methods often require a large amount of high-quality training data while producing a small number (e.g., tens) of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chunpeng Wu , Wei Wen , Yiran Chen , Hai Li

Fine-grained facial expression manipulation is a challenging problem, as fine-grained expression details are difficult to be captured. Most existing expression manipulation methods resort to discrete expression labels, which mainly edit…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Junshu Tang , Zhiwen Shao , Lizhuang Ma

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

Collecting well-annotated image datasets to train modern machine learning algorithms is prohibitively expensive for many tasks. One appealing alternative is rendering synthetic data where ground-truth annotations are generated…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Konstantinos Bousmalis , Nathan Silberman , David Dohan , Dumitru Erhan , Dilip Krishnan

Learning a disentangled representation of the latent space has become one of the most fundamental problems studied in computer vision. Recently, many Generative Adversarial Networks (GANs) have shown promising results in generating high…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Kumar Shubham , Gopalakrishnan Venkatesh , Reijul Sachdev , Akshi , Dinesh Babu Jayagopi , G. Srinivasaraghavan

We propose a novel framework for simultaneously generating and manipulating the face images with desired attributes. While the state-of-the-art attribute editing technique has achieved the impressive performance for creating realistic…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Kyungjune Baek , Duhyeon Bang , Hyunjung Shim

Image generation has been heavily investigated in computer vision, where one core research challenge is to generate images from arbitrarily complex distributions with little supervision. Generative Adversarial Networks (GANs) as an implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Hui Ying , He Wang , Tianjia Shao , Yin Yang , Kun Zhou

Generative Adversarial Networks (GANs) have recently achieved significant improvement on paired/unpaired image-to-image translation, such as photo$\rightarrow$ sketch and artist painting style transfer. However, existing models can only be…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Xiaodan Liang , Hao Zhang , Eric P. Xing

Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Peiye Zhuang , Oluwasanmi Koyejo , Alexander G. Schwing

Generative Adversarial Network (GAN) based localized image editing can suffer from ambiguity between semantic attributes. We thus present a novel objective function to evaluate the locality of an image edit. By introducing the supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Ehsan Pajouheshgar , Tong Zhang , Sabine Süsstrunk

Altering the content of an image with photo editing tools is a tedious task for an inexperienced user. Especially, when modifying the visual attributes of a specific object in an image without affecting other constituents such as background…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Dawei Zhu , Aditya Mogadala , Dietrich Klakow

Generative Adversarial Networks (GAN) is currently widely used as an unsupervised image generation method. Current state-of-the-art GANs can generate photorealistic images with high resolution. However, a large amount of data is required,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Pengwei Wang

Recent advances in the field of generative models and in particular generative adversarial networks (GANs) have lead to substantial progress for controlled image editing, especially compared with the pre-deep learning era. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Gwilherm Lesné , Yann Gousseau , Saïd Ladjal , Alasdair Newson

Recent advances in high-fidelity semantic image editing heavily rely on the presumably disentangled latent spaces of the state-of-the-art generative models, such as StyleGAN. Specifically, recent works show that it is possible to achieve…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Valentin Khrulkov , Leyla Mirvakhabova , Ivan Oseledets , Artem Babenko

High quality facial image editing is a challenging problem in the movie post-production industry, requiring a high degree of control and identity preservation. Previous works that attempt to tackle this problem may suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

Contemporary benchmark methods for image inpainting are based on deep generative models and specifically leverage adversarial loss for yielding realistic reconstructions. However, these models cannot be directly applied on image/video…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Avisek Lahiri , Arnav Jain , Prabir Kumar Biswas , Pabitra Mitra