English
Related papers

Related papers: DragGANSpace: Latent Space Exploration and Control…

200 papers

Progress in GANs has enabled the generation of high-resolution photorealistic images of astonishing quality. StyleGANs allow for compelling attribute modification on such images via mathematical operations on the latent style vectors in the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Tejan Karmali , Rishubh Parihar , Susmit Agrawal , Harsh Rangwani , Varun Jampani , Maneesh Singh , R. Venkatesh Babu

Although Generative Adversarial Networks (GANs) have made significant progress in face synthesis, there lacks enough understanding of what GANs have learned in the latent representation to map a random code to a photo-realistic image. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Yujun Shen , Ceyuan Yang , Xiaoou Tang , Bolei Zhou

Recent advances in high-fidelity semantic image editing heavily rely on the presumably disentangled latent spaces of the state-of-the-art generative models, such as StyleGAN. Specifically, recent works show that it is possible to achieve…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Valentin Khrulkov , Leyla Mirvakhabova , Ivan Oseledets , Artem Babenko

Generative adversarial networks (GANs) have proven to be surprisingly efficient for image editing by inverting and manipulating the latent code corresponding to a natural image. This property emerges from the disentangled nature of the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Mustafa Shukor , Xu Yao , Bharath Bhushan Damodaran , Pierre Hellier

Learning disentangled representations of data is a fundamental problem in artificial intelligence. Specifically, disentangled latent representations allow generative models to control and compose the disentangled factors in the synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Yotam Nitzan , Amit Bermano , Yangyan Li , Daniel Cohen-Or

Several research groups have shown that Generative Adversarial Networks (GANs) can generate photo-realistic images in recent years. Using the GANs, a map is created between a latent code and a photo-realistic image. This process can also be…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Andrea Giardina , Soumya Subhra Paria , Adhikari Kaustubh

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

Various controls over the generated data can be extracted from the latent space of a pre-trained GAN, as it implicitly encodes the semantics of the training data. The discovered controls allow to vary semantic attributes in the generated…

Machine Learning · Computer Science 2022-01-28 Perla Doubinsky , Nicolas Audebert , Michel Crucianu , Hervé Le Borgne

Recent inversion methods have shown that real images can be inverted into StyleGAN's latent space and numerous edits can be achieved on those images thanks to the semantically rich feature representations of well-trained GAN models.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Ahmet Burak Yildirim , Hamza Pehlivan , Bahri Batuhan Bilecen , Aysegul Dundar

The impressive success of style-based GANs (StyleGANs) in high-fidelity image synthesis has motivated research to understand the semantic properties of their latent spaces. In this paper, we approach this problem through a geometric…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Jaewoong Choi , Geonho Hwang , Hyunsoo Cho , Myungjoo Kang

High quality facial image editing is a challenging problem in the movie post-production industry, requiring a high degree of control and identity preservation. Previous works that attempt to tackle this problem may suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

This paper is on face/head reenactment where the goal is to transfer the facial pose (3D head orientation and expression) of a target face to a source face. Previous methods focus on learning embedding networks for identity and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Stella Bounareli , Vasileios Argyriou , Georgios Tzimiropoulos

Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

Generative adversarial networks (GANs) have recently found applications in image editing. However, most GAN based image editing methods often require large scale datasets with semantic segmentation annotations for training, only provide…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Huan Ling , Karsten Kreis , Daiqing Li , Seung Wook Kim , Antonio Torralba , Sanja Fidler

The recent success of text-to-image synthesis has taken the world by storm and captured the general public's imagination. From a technical standpoint, it also marked a drastic change in the favored architecture to design generative image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Minguk Kang , Jun-Yan Zhu , Richard Zhang , Jaesik Park , Eli Shechtman , Sylvain Paris , Taesung Park

Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Peiye Zhuang , Oluwasanmi Koyejo , Alexander G. Schwing

Recent advances in Generative Artificial Intelligence have fueled numerous applications, particularly those involving Generative Adversarial Networks (GANs), which are essential for synthesizing realistic photos and videos. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-07 Ziji Shi , Jialin Li , Yang You

This paper tackles text-guided control of StyleGAN for editing garments in full-body human images. Existing StyleGAN-based methods suffer from handling the rich diversity of garments and body shapes and poses. We propose a framework for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Takato Yoshikawa , Yuki Endo , Yoshihiro Kanamori

Image synthesis via Generative Adversarial Networks (GANs) of three-dimensional (3D) medical images has great potential that can be extended to many medical applications, such as, image enhancement and disease progression modeling. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-07-22 Sungmin Hong , Razvan Marinescu , Adrian V. Dalca , Anna K. Bonkhoff , Martin Bretzner , Natalia S. Rost , Polina Golland

This work presents an easy-to-use regularizer for GAN training, which helps explicitly link some axes of the latent space to a set of pixels in the synthesized image. Establishing such a connection facilitates a more convenient local…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiapeng Zhu , Ceyuan Yang , Yujun Shen , Zifan Shi , Bo Dai , Deli Zhao , Qifeng Chen