English
Related papers

Related papers: Make It So: Steering StyleGAN for Any Image Invers…

200 papers

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

The task of manipulating real image attributes through StyleGAN inversion has been extensively researched. This process involves searching latent variables from a well-trained StyleGAN generator that can synthesize a real image, modifying…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Denis Bobkov , Vadim Titov , Aibek Alanov , Dmitry Vetrov

We present a novel image inversion framework and a training pipeline to achieve high-fidelity image inversion with high-quality attribute editing. Inverting real images into StyleGAN's latent space is an extensively studied problem, yet the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Hamza Pehlivan , Yusuf Dalva , Aysegul Dundar

Employing the latent space of pretrained generators has recently been shown to be an effective means for GAN-based face manipulation. The success of this approach heavily relies on the innate disentanglement of the latent space axes of the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Xianxu Hou , Linlin Shen , Or Patashnik , Daniel Cohen-Or , Hui Huang

Recent advances in generative adversarial networks (GANs) have led to remarkable achievements in face image synthesis. While methods that use style-based GANs can generate strikingly photorealistic face images, it is often difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Safa C. Medin , Bernhard Egger , Anoop Cherian , Ye Wang , Joshua B. Tenenbaum , Xiaoming Liu , Tim K. Marks

Despite the recent success of GANs in synthesizing images conditioned on inputs such as a user sketch, text, or semantic labels, manipulating the high-level attributes of an existing natural photograph with GANs is challenging for two…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 David Bau , Hendrik Strobelt , William Peebles , Jonas Wulff , Bolei Zhou , Jun-Yan Zhu , Antonio Torralba

Computed medical imaging systems require a computational reconstruction procedure for image formation. In order to recover a useful estimate of the object to-be-imaged when the recorded measurements are incomplete, prior knowledge about the…

Image and Video Processing · Electrical Eng. & Systems 2022-02-21 Varun A. Kelkar , Mark A. Anastasio

Latent space exploration is a technique that discovers interpretable latent directions and manipulates latent codes to edit various attributes in images generated by generative adversarial networks (GANs). However, in previous work, spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Yuki Endo

High-quality, diverse, and photorealistic images can now be generated by unconditional GANs (e.g., StyleGAN). However, limited options exist to control the generation process using (semantic) attributes, while still preserving the quality…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Rameen Abdal , Peihao Zhu , Niloy Mitra , Peter Wonka

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou

Recently, there has been an increasing interest in image editing methods that employ pre-trained unconditional image generators (e.g., StyleGAN). However, applying these methods to translate images to multiple visual domains remains…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Yahui Liu , Yajing Chen , Linchao Bao , Nicu Sebe , Bruno Lepri , Marco De Nadai

The semantically disentangled latent subspace in GAN provides rich interpretable controls in image generation. This paper includes two contributions on semantic latent subspace analysis in the scenario of face generation using StyleGAN2.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Bo Li , Qiulin Wang , Jiquan Pei , Yu Yang , Xiangyang Ji

Generative adversarial networks (GANs) can synthesize high-quality (HQ) images, and GAN inversion is a technique that discovers how to invert given images back to latent space. While existing methods perform on StyleGAN inversion, they have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Cheng Yu , Wenmin Wang , Roberto Bugiolacchi

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel-wise style…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Zongze Wu , Dani Lischinski , Eli Shechtman

The latent space of GANs contains rich semantics reflecting the training data. Different methods propose to learn edits in latent space corresponding to semantic attributes, thus allowing to modify generated images. Most supervised methods…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Perla Doubinsky , Nicolas Audebert , Michel Crucianu , Hervé Le Borgne

For successful semantic editing of real images, it is critical for a GAN inversion method to find an in-domain latent code that aligns with the domain of a pre-trained GAN model. Unfortunately, such in-domain latent codes can be found only…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Kyoungkook Kang , Seongtae Kim , Sunghyun Cho

Empirical works suggest that various semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to generate images. To perform real image editing, it requires an accurate mapping from the real image to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Guangjie Leng , Yekun Zhu , Zhi-Qin John Xu

The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator. Embedding a given image back to the latent space of StyleGAN enables wide interesting semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Shanyan Guan , Ying Tai , Bingbing Ni , Feida Zhu , Feiyue Huang , Xiaokang Yang

Generative Adversarial Networks (GANs) have significantly advanced image synthesis through mapping randomly sampled latent codes to high-fidelity synthesized images. However, applying well-trained GANs to real image editing remains…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiapeng Zhu , Yujun Shen , Yinghao Xu , Deli Zhao , Qifeng Chen , Bolei Zhou

The recent success in StyleGAN demonstrates that pre-trained StyleGAN latent space is useful for realistic video generation. However, the generated motion in the video is usually not semantically meaningful due to the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Seung Hyun Lee , Gyeongrok Oh , Wonmin Byeon , Chanyoung Kim , Won Jeong Ryoo , Sang Ho Yoon , Hyunjun Cho , Jihyun Bae , Jinkyu Kim , Sangpil Kim