English
Related papers

Related papers: VecGAN: Image-to-Image Translation with Interpreta…

200 papers

Unpaired image-to-image translation is the problem of mapping an image in the source domain to one in the target domain, without requiring corresponding image pairs. To ensure the translated images are realistically plausible, recent works,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-13 Anoop Cherian , Alan Sullivan

In this paper, we aim at solving the multi-domain image-to-image translation problem with a unified model in an unsupervised manner. The most successful work in this area refers to StarGAN, which works well in tasks like face attribute…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Xiao Liu , Shengchuan Zhang , Hong Liu , Xin Liu , Cheng Deng , Rongrong Ji

Existing GAN inversion methods fail to provide latent codes for reliable reconstruction and flexible editing simultaneously. This paper presents a transformer-based image inversion and editing model for pretrained StyleGAN which is not only…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Xueqi Hu , Qiusheng Huang , Zhengyi Shi , Siyuan Li , Changxin Gao , Li Sun , Qingli Li

This paper proposes a novel and physically interpretable method for face editing based on arbitrary text prompts. Different from previous GAN-inversion-based face editing methods that manipulate the latent space of GANs, or diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yapeng Meng , Songru Yang , Xu Hu , Rui Zhao , Lincheng Li , Zhenwei Shi , Zhengxia Zou

Recent works for face editing usually manipulate the latent space of StyleGAN via the linear semantic directions. However, they usually suffer from the entanglement of facial attributes, need to tune the optimal editing strength, and are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Zhizhong Huang , Siteng Ma , Junping Zhang , Hongming Shan

In this work, we introduce an important but still unexplored research task -- image sentiment transfer. Compared with other related tasks that have been well-studied, such as image-to-image translation and image style transfer, transferring…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Tianlang Chen , Wei Xiong , Haitian Zheng , Jiebo Luo

In this work, we propose TediGAN, a novel framework for multi-modal image generation and manipulation with textual descriptions. The proposed method consists of three components: StyleGAN inversion module, visual-linguistic similarity…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Weihao Xia , Yujiu Yang , Jing-Hao Xue , Baoyuan Wu

The ability to edit facial expressions has a wide range of applications in computer graphics. The ideal facial expression editing algorithm needs to satisfy two important criteria. First, it should allow precise and targeted editing of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Alara Zindancıoğlu , T. Metin Sezgin

Image-to-image translation, which translates input images to a different domain with a learned one-to-one mapping, has achieved impressive success in recent years. The success of translation mainly relies on the network architecture to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Wenju Xu , Shawn Keshmiri , Guanghui Wang

Drawing upon StyleGAN's expressivity and disentangled latent space, existing 2D approaches employ textual prompting to edit facial images with different attributes. In contrast, 3D-aware approaches that generate faces at different target…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Amandeep Kumar , Muhammad Awais , Sanath Narayan , Hisham Cholakkal , Salman Khan , Rao Muhammad Anwer

Although Generative Adversarial Networks (GANs) have made significant progress in face synthesis, there lacks enough understanding of what GANs have learned in the latent representation to map a random code to a photo-realistic image. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Yujun Shen , Ceyuan Yang , Xiaoou Tang , Bolei Zhou

Deep generative models, like GANs, have considerably improved the state of the art in image synthesis, and are able to generate near photo-realistic images in structured domains such as human faces. Based on this success, recent work on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Guillaume Couairon , Asya Grechka , Jakob Verbeek , Holger Schwenk , Matthieu Cord

State-of-the-art methods in image-to-image translation are capable of learning a mapping from a source domain to a target domain with unpaired image data. Though the existing methods have achieved promising results, they still produce…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Hao Tang , Hong Liu , Dan Xu , Philip H. S. Torr , Nicu Sebe

In this paper, we present FaceTuneGAN, a new 3D face model representation decomposing and encoding separately facial identity and facial expression. We propose a first adaptation of image-to-image translation networks, that have…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Nicolas Olivier , Kelian Baert , Fabien Danieau , Franck Multon , Quentin Avril

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

The inversion of real images into StyleGAN's latent space is a well-studied problem. Nevertheless, applying existing approaches to real-world scenarios remains an open challenge, due to an inherent trade-off between reconstruction and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yuval Alaluf , Omer Tov , Ron Mokady , Rinon Gal , Amit H. Bermano

Most existing methods view makeup transfer as transferring color distributions of different facial regions and ignore details such as eye shadows and blushes. Besides, they only achieve controllable transfer within predefined fixed regions.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Chenyu Yang , Wanrong He , Yingqing Xu , Yang Gao

Learning-based gaze estimation methods require large amounts of training data with accurate gaze annotations. Facing such demanding requirements of gaze data collection and annotation, several image synthesis methods were proposed, which…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Shiwei Jin , Zhen Wang , Lei Wang , Ning Bi , Truong Nguyen

Image manipulation with StyleGAN has been an increasing concern in recent years.Recent works have achieved tremendous success in analyzing several semantic latent spaces to edit the attributes of the generated images.However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Rui Wang , Jian Chen , Gang Yu , Li Sun , Changqian Yu , Changxin Gao , Nong Sang

Image editing using a pretrained StyleGAN generator has emerged as a powerful paradigm for facial editing, providing disentangled controls over age, expression, illumination, etc. However, the approach cannot be directly adopted for video…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Rameen Abdal , Peihao Zhu , Niloy J. Mitra , Peter Wonka