English
Related papers

Related papers: VecGAN: Image-to-Image Translation with Interpreta…

200 papers

The goal of this paper is to embed controllable factors, i.e., natural language descriptions, into image-to-image translation with generative adversarial networks, which allows text descriptions to determine the visual attributes of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Bowen Li , Xiaojuan Qi , Philip H. S. Torr , Thomas Lukasiewicz

Researchers have recently begun exploring the use of StyleGAN-based models for real image editing. One particularly interesting application is using natural language descriptions to guide the editing process. Existing approaches for editing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Ahmet Canberk Baykal , Abdul Basit Anees , Duygu Ceylan , Erkut Erdem , Aykut Erdem , Deniz Yuret

In this paper, we perform an in-depth study of the properties and applications of aligned generative models. We refer to two models as aligned if they share the same architecture, and one of them (the child) is obtained from the other (the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Zongze Wu , Yotam Nitzan , Eli Shechtman , Dani Lischinski

Image manipulation on the latent space of the pre-trained StyleGAN can control the semantic attributes of the generated images. Recently, some studies have focused on detecting channels with specific properties to directly manipulate the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Yuanjie Yan , Jian Zhao , Furao Shen

Employing the latent space of pretrained generators has recently been shown to be an effective means for GAN-based face manipulation. The success of this approach heavily relies on the innate disentanglement of the latent space axes of the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Xianxu Hou , Linlin Shen , Or Patashnik , Daniel Cohen-Or , Hui Huang

In recent years, image generation has made great strides in improving the quality of images, producing high-fidelity ones. Also, quite recently, there are architecture designs, which enable GAN to unsupervisedly learn the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Xin Jin , Shu Zhao , Le Zhang , Xin Zhao , Qiang Deng , Chaoen Xiao

Despite recent advances in semantic manipulation using StyleGAN, semantic editing of real faces remains challenging. The gap between the $W$ space and the $W$+ space demands an undesirable trade-off between reconstruction quality and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Heyi Li , Jinlong Liu , Xinyu Zhang , Yunzhi Bai , Huayan Wang , Klaus Mueller

Content creation and image editing can benefit from flexible user controls. A common intermediate representation for conditional image generation is a semantic map, that has information of objects present in the image. When compared to raw…

Artificial Intelligence · Computer Science 2024-01-25 Chandrakanth Gudavalli , Erik Rosten , Lakshmanan Nataraj , Shivkumar Chandrasekaran , B. S. Manjunath

In this paper, we propose a novel framework to translate a portrait photo-face into an anime appearance. Our aim is to synthesize anime-faces which are style-consistent with a given reference anime-face. However, unlike typical translation…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Bing Li , Yuanlue Zhu , Yitong Wang , Chia-Wen Lin , Bernard Ghanem , Linlin Shen

Recent studies on multi-domain facial image translation have achieved impressive results. The existing methods generally provide a discriminator with an auxiliary classifier to impose domain translation. However, these methods neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Xiaokang Zhang , Yuanlue Zhu , Wenting Chen , Wenshuang Liu , Linlin Shen

Recent works on language-guided image manipulation have shown great power of language in providing rich semantics, especially for face images. However, the other natural information, motions, in language is less explored. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Tiankai Hang , Huan Yang , Bei Liu , Jianlong Fu , Xin Geng , Baining Guo

Facial editing is an important task in vision and graphics with numerous applications. However, existing works are incapable to deliver a continuous and fine-grained editing mode (e.g., editing a slightly smiling face to a big laughing one)…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Yuming Jiang , Ziqi Huang , Xingang Pan , Chen Change Loy , Ziwei Liu

The semantically disentangled latent subspace in GAN provides rich interpretable controls in image generation. This paper includes two contributions on semantic latent subspace analysis in the scenario of face generation using StyleGAN2.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Bo Li , Qiulin Wang , Jiquan Pei , Yu Yang , Xiangyang Ji

Facial expression editing is a challenging task as it needs a high-level semantic understanding of the input face image. In conventional methods, either paired training data is required or the synthetic face resolution is low. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Hui Ding , Kumar Sricharan , Rama Chellappa

We introduce EnhanceGAN, an adversarial learning based model that performs automatic image enhancement. Traditional image enhancement frameworks typically involve training models in a fully-supervised manner, which require expensive…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Yubin Deng , Chen Change Loy , Xiaoou Tang

This paper presents an innovative approach to achieve face cartoonisation while preserving the original identity and accommodating various poses. Unlike previous methods in this field that relied on conditional-GANs, which posed challenges…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Kushal Jain , Ankith Varun J , Anoop Namboodiri

This paper addresses the problem of finding interpretable directions in the latent space of pre-trained Generative Adversarial Networks (GANs) to facilitate controllable image synthesis. Such interpretable directions correspond to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 James Oldfield , Markos Georgopoulos , Yannis Panagakis , Mihalis A. Nicolaou , Ioannis Patras

In recent years, image editing has advanced remarkably. With increased human control, it is now possible to edit an image in a plethora of ways; from specifying in text what we want to change, to straight up dragging the contents of the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Thao Nguyen , Utkarsh Ojha , Yuheng Li , Haotian Liu , Yong Jae Lee

In this paper, we present an integrated system for automatically generating and editing face images through face swapping, attribute-based editing, and random face parts synthesis. The proposed system is based on a deep neural network that…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Ryota Natsume , Tatsuya Yatagawa , Shigeo Morishima

Pixel-level fine-grained image editing remains an open challenge. Previous works fail to achieve an ideal trade-off between control granularity and inference speed. They either fail to achieve pixel-level fine-grained control, or their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Pengxiang Cai , Zhiwei Liu , Guibo Zhu , Yunfang Niu , Jinqiao Wang