English
Related papers

Related papers: Towards Disentangling Latent Space for Unsupervise…

200 papers

Interactive facial image manipulation attempts to edit single and multiple face attributes using a photo-realistic face and/or semantic mask as input. In the absence of the photo-realistic image (only sketch/mask available), previous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yan Yang , Md Zakir Hossain , Tom Gedeon , Shafin Rahman

The success of StyleGAN has enabled unprecedented semantic editing capabilities, on both synthesized and real images. However, such editing operations are either trained with semantic supervision or described using human guidance. In…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Rameen Abdal , Peihao Zhu , John Femiani , Niloy J. Mitra , Peter Wonka

This paper introduces the Attribute-Decomposed GAN, a novel generative model for controllable person image synthesis, which can produce realistic person images with desired human attributes (e.g., pose, head, upper clothes and pants)…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Yifang Men , Yiming Mao , Yuning Jiang , Wei-Ying Ma , Zhouhui Lian

The SOTA face swap models still suffer the problem of either target identity (i.e., shape) being leaked or the target non-identity attributes (i.e., background, hair) failing to be fully preserved in the final results. We show that this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Xiaohang Ren , Xingyu Chen , Pengfei Yao , Heung-Yeung Shum , Baoyuan Wang

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

We propose a framework, called LiftedGAN, that disentangles and lifts a pre-trained StyleGAN2 for 3D-aware face generation. Our model is "3D-aware" in the sense that it is able to (1) disentangle the latent space of StyleGAN2 into texture,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Yichun Shi , Divyansh Aggarwal , Anil K. Jain

Recently, Generative Adversarial Networks (GANs)} have been widely used for portrait image generation. However, in the latent space learned by GANs, different attributes, such as pose, shape, and texture style, are generally entangled,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Anpei Chen , Ruiyang Liu , Ling Xie , Zhang Chen , Hao Su , Jingyi Yu

Facial image manipulation has achieved great progress in recent years. However, previous methods either operate on a predefined set of face attributes or leave users little freedom to interactively manipulate images. To overcome these…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Cheng-Han Lee , Ziwei Liu , Lingyun Wu , Ping Luo

We focus on explicitly learning disentangled representation for natural image generation, where the underlying spatial structure and the rendering on the structure can be independently controlled respectively, yet using no tuple…

Machine Learning · Computer Science 2019-10-01 Guang-Yuan Hao , Hong-Xing Yu , Wei-Shi Zheng

The recent GAN inversion methods have been able to successfully invert the real image input to the corresponding editable latent code in StyleGAN. By combining with the language-vision model (CLIP), some text-driven image manipulation…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Yunpeng Bai , Zihan Zhong , Chao Dong , Weichen Zhang , Guowei Xu , Chun Yuan

Existing methods for face image manipulation generally focus on editing the expression, changing some predefined attributes, or applying different filters. However, users lack the flexibility of controlling the shapes of different semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Sen-Zhe Xu , Hao-Zhi Huang , Shi-Min Hu , Wei Liu

StyleGAN2 is a state-of-the-art network in generating realistic images. Besides, it was explicitly trained to have disentangled directions in latent space, which allows efficient image manipulation by varying latent factors. Editing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Yuri Viazovetskyi , Vladimir Ivashkin , Evgeny Kashin

Recent studies on facial expression editing have obtained very promising progress. On the other hand, existing methods face the constraint of requiring a large amount of expression labels which are often expensive and time-consuming to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Rongliang Wu , Shijian Lu

Despite the significant success in image-to-image translation and latent representation based facial attribute editing and expression synthesis, the existing approaches still have limitations in the sharpness of details, distinct image…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 WenTing Chen , Xinpeng Xie , Xi Jia , Linlin Shen

Hairstyle transfer is challenging due to hair structure differences in the source and target hair. Therefore, we propose Latent Optimization of Hairstyles via Orthogonalization (LOHO), an optimization-based approach using GAN inversion to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Rohit Saha , Brendan Duke , Florian Shkurti , Graham W. Taylor , Parham Aarabi

Generative adversarial networks (GANs) have recently found applications in image editing. However, most GAN based image editing methods often require large scale datasets with semantic segmentation annotations for training, only provide…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Huan Ling , Karsten Kreis , Daiqing Li , Seung Wook Kim , Antonio Torralba , Sanja Fidler

Recently, there has been a surge of diverse methods for performing image editing by employing pre-trained unconditional generators. Applying these methods on real images, however, remains a challenge, as it necessarily requires the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Omer Tov , Yuval Alaluf , Yotam Nitzan , Or Patashnik , Daniel Cohen-Or

Existing GAN inversion and editing methods work well for aligned objects with a clean background, such as portraits and animal faces, but often struggle for more difficult categories with complex scene layouts and object occlusions, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Gaurav Parmar , Yijun Li , Jingwan Lu , Richard Zhang , Jun-Yan Zhu , Krishna Kumar Singh

Editing real facial images is a crucial task in computer vision with significant demand in various real-world applications. While GAN-based methods have showed potential in manipulating images especially when combined with CLIP, these…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Dongxu Yue , Qin Guo , Munan Ning , Jiaxi Cui , Yuesheng Zhu , Li Yuan

The task of manipulating real image attributes through StyleGAN inversion has been extensively researched. This process involves searching latent variables from a well-trained StyleGAN generator that can synthesize a real image, modifying…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Denis Bobkov , Vadim Titov , Aibek Alanov , Dmitry Vetrov