English
Related papers

Related papers: Rayleigh EigenDirections (REDs): GAN latent space …

200 papers

The discovery of the disentanglement properties of the latent space in GANs motivated a lot of research to find the semantically meaningful directions on it. In this paper, we suggest that the disentanglement property is closely related to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Jaewoong Choi , Junho Lee , Changyeon Yoon , Jung Ho Park , Geonho Hwang , Myungjoo Kang

In just a few years, the photo-realism of images synthesized by Generative Adversarial Networks (GANs) has gone from somewhat reasonable to almost perfect largely by increasing the complexity of the networks, e.g., adding layers,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Jeffrey Wen , Fabian Benitez-Quiroz , Qianli Feng , Aleix Martinez

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

Despite the recent advance of Generative Adversarial Networks (GANs) in high-fidelity image synthesis, there lacks enough understanding of how GANs are able to map a latent code sampled from a random distribution to a photo-realistic image.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Yujun Shen , Jinjin Gu , Xiaoou Tang , Bolei Zhou

The impressive success of style-based GANs (StyleGANs) in high-fidelity image synthesis has motivated research to understand the semantic properties of their latent spaces. In this paper, we approach this problem through a geometric…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Jaewoong Choi , Geonho Hwang , Hyunsoo Cho , Myungjoo Kang

Generative adversarial networks (GANs) have attained photo-realistic quality in image generation. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN which is trained…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xingzhe He , Bastian Wandt , Helge Rhodin

Generative adversarial networks have been widely used in image synthesis in recent years and the quality of the generated image has been greatly improved. However, the flexibility to control and decouple facial attributes (e.g., eyes, nose,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Xiao Cui , Wengang Zhou , Yang Hu , Weilun Wang , Houqiang Li

In this paper, we investigate an open research task of generating 3D cartoon face shapes from single 2D GAN generated human faces and without 3D supervision, where we can also manipulate the facial expressions of the 3D shapes. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Hao Wang , Wenhao Shen , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

Current Generative Adversarial Networks (GANs) produce photorealistic renderings of portrait images. Embedding real images into the latent space of such models enables high-level image editing. While recent methods provide considerable…

Graphics · Computer Science 2021-09-21 Thomas Leimkühler , George Drettakis

High-quality, diverse, and photorealistic images can now be generated by unconditional GANs (e.g., StyleGAN). However, limited options exist to control the generation process using (semantic) attributes, while still preserving the quality…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Rameen Abdal , Peihao Zhu , Niloy Mitra , Peter Wonka

Generative adversarial networks (GANs) have proven to be surprisingly efficient for image editing by inverting and manipulating the latent code corresponding to an input real image. This editing property emerges from the disentangled nature…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Mustafa Shukor , Xu Yao , Bharath Bushan Damodaran , Pierre Hellier

In this paper, we present our framework for neural face/head reenactment whose goal is to transfer the 3D head orientation and expression of a target face to a source face. Previous methods focus on learning embedding networks for identity…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Stella Bounareli , Christos Tzelepis , Vasileios Argyriou , Ioannis Patras , Georgios Tzimiropoulos

Pixel-level fine-grained image editing remains an open challenge. Previous works fail to achieve an ideal trade-off between control granularity and inference speed. They either fail to achieve pixel-level fine-grained control, or their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Pengxiang Cai , Zhiwei Liu , Guibo Zhu , Yunfang Niu , Jinqiao Wang

Despite the success of diffusion models (DMs), we still lack a thorough understanding of their latent space. While image editing with GANs builds upon latent space, DMs rely on editing the conditions such as text prompts. We present an…

Computer Vision and Pattern Recognition · Computer Science 2023-02-27 Yong-Hyun Park , Mingi Kwon , Junghyo Jo , Youngjung Uh

Although manipulating facial attributes by Generative Adversarial Networks (GANs) has been remarkably successful recently, there are still some challenges in explicit control of features such as pose, expression, lighting, etc. Recent…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yuanming Li , Jeong-gi Kwak , David Han , Hanseok Ko

Face editing represents a popular research topic within the computer vision and image processing communities. While significant progress has been made recently in this area, existing solutions: (i) are still largely focused on…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Martin Pernuš , Vitomir Štruc , Simon Dobrišek

Recent studies on Generative Adversarial Network (GAN) reveal that different layers of a generative CNN hold different semantics of the synthesized images. However, few GAN models have explicit dimensions to control the semantic attributes…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Zhenliang He , Meina Kan , Shiguang Shan

The semantically disentangled latent subspace in GAN provides rich interpretable controls in image generation. This paper includes two contributions on semantic latent subspace analysis in the scenario of face generation using StyleGAN2.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Bo Li , Qiulin Wang , Jiquan Pei , Yu Yang , Xiangyang Ji

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel-wise style…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Zongze Wu , Dani Lischinski , Eli Shechtman

Generating preferred images using generative adversarial networks (GANs) is challenging owing to the high-dimensional nature of latent space. In this study, we propose a novel approach that uses simple user-swipe interactions to generate…

Human-Computer Interaction · Computer Science 2024-05-01 Yuto Nakashima , Mingzhe Yang , Yukino Baba