中文
相关论文

相关论文: Make It So: Steering StyleGAN for Any Image Invers…

200 篇论文

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

机器学习 · 计算机科学 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

The task of manipulating real image attributes through StyleGAN inversion has been extensively researched. This process involves searching latent variables from a well-trained StyleGAN generator that can synthesize a real image, modifying…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Denis Bobkov , Vadim Titov , Aibek Alanov , Dmitry Vetrov

We present a novel image inversion framework and a training pipeline to achieve high-fidelity image inversion with high-quality attribute editing. Inverting real images into StyleGAN's latent space is an extensively studied problem, yet the…

计算机视觉与模式识别 · 计算机科学 2023-01-02 Hamza Pehlivan , Yusuf Dalva , Aysegul Dundar

Employing the latent space of pretrained generators has recently been shown to be an effective means for GAN-based face manipulation. The success of this approach heavily relies on the innate disentanglement of the latent space axes of the…

计算机视觉与模式识别 · 计算机科学 2022-02-08 Xianxu Hou , Linlin Shen , Or Patashnik , Daniel Cohen-Or , Hui Huang

Recent advances in generative adversarial networks (GANs) have led to remarkable achievements in face image synthesis. While methods that use style-based GANs can generate strikingly photorealistic face images, it is often difficult to…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Safa C. Medin , Bernhard Egger , Anoop Cherian , Ye Wang , Joshua B. Tenenbaum , Xiaoming Liu , Tim K. Marks

Despite the recent success of GANs in synthesizing images conditioned on inputs such as a user sketch, text, or semantic labels, manipulating the high-level attributes of an existing natural photograph with GANs is challenging for two…

计算机视觉与模式识别 · 计算机科学 2020-09-15 David Bau , Hendrik Strobelt , William Peebles , Jonas Wulff , Bolei Zhou , Jun-Yan Zhu , Antonio Torralba

Computed medical imaging systems require a computational reconstruction procedure for image formation. In order to recover a useful estimate of the object to-be-imaged when the recorded measurements are incomplete, prior knowledge about the…

图像与视频处理 · 电气工程与系统科学 2022-02-21 Varun A. Kelkar , Mark A. Anastasio

Latent space exploration is a technique that discovers interpretable latent directions and manipulates latent codes to edit various attributes in images generated by generative adversarial networks (GANs). However, in previous work, spatial…

计算机视觉与模式识别 · 计算机科学 2022-08-29 Yuki Endo

High-quality, diverse, and photorealistic images can now be generated by unconditional GANs (e.g., StyleGAN). However, limited options exist to control the generation process using (semantic) attributes, while still preserving the quality…

计算机视觉与模式识别 · 计算机科学 2021-10-06 Rameen Abdal , Peihao Zhu , Niloy Mitra , Peter Wonka

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

计算机视觉与模式识别 · 计算机科学 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou

Recently, there has been an increasing interest in image editing methods that employ pre-trained unconditional image generators (e.g., StyleGAN). However, applying these methods to translate images to multiple visual domains remains…

计算机视觉与模式识别 · 计算机科学 2022-03-07 Yahui Liu , Yajing Chen , Linchao Bao , Nicu Sebe , Bruno Lepri , Marco De Nadai

The semantically disentangled latent subspace in GAN provides rich interpretable controls in image generation. This paper includes two contributions on semantic latent subspace analysis in the scenario of face generation using StyleGAN2.…

计算机视觉与模式识别 · 计算机科学 2022-01-25 Bo Li , Qiulin Wang , Jiquan Pei , Yu Yang , Xiangyang Ji

Generative adversarial networks (GANs) can synthesize high-quality (HQ) images, and GAN inversion is a technique that discovers how to invert given images back to latent space. While existing methods perform on StyleGAN inversion, they have…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Cheng Yu , Wenmin Wang , Roberto Bugiolacchi

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel-wise style…

计算机视觉与模式识别 · 计算机科学 2020-12-04 Zongze Wu , Dani Lischinski , Eli Shechtman

The latent space of GANs contains rich semantics reflecting the training data. Different methods propose to learn edits in latent space corresponding to semantic attributes, thus allowing to modify generated images. Most supervised methods…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Perla Doubinsky , Nicolas Audebert , Michel Crucianu , Hervé Le Borgne

For successful semantic editing of real images, it is critical for a GAN inversion method to find an in-domain latent code that aligns with the domain of a pre-trained GAN model. Unfortunately, such in-domain latent codes can be found only…

计算机视觉与模式识别 · 计算机科学 2021-08-23 Kyoungkook Kang , Seongtae Kim , Sunghyun Cho

Empirical works suggest that various semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to generate images. To perform real image editing, it requires an accurate mapping from the real image to…

计算机视觉与模式识别 · 计算机科学 2021-07-15 Guangjie Leng , Yekun Zhu , Zhi-Qin John Xu

The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator. Embedding a given image back to the latent space of StyleGAN enables wide interesting semantic…

计算机视觉与模式识别 · 计算机科学 2020-07-06 Shanyan Guan , Ying Tai , Bingbing Ni , Feida Zhu , Feiyue Huang , Xiaokang Yang

Generative Adversarial Networks (GANs) have significantly advanced image synthesis through mapping randomly sampled latent codes to high-fidelity synthesized images. However, applying well-trained GANs to real image editing remains…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Jiapeng Zhu , Yujun Shen , Yinghao Xu , Deli Zhao , Qifeng Chen , Bolei Zhou

The recent success in StyleGAN demonstrates that pre-trained StyleGAN latent space is useful for realistic video generation. However, the generated motion in the video is usually not semantically meaningful due to the difficulty of…

计算机视觉与模式识别 · 计算机科学 2022-10-24 Seung Hyun Lee , Gyeongrok Oh , Wonmin Byeon , Chanyoung Kim , Won Jeong Ryoo , Sang Ho Yoon , Hyunjun Cho , Jihyun Bae , Jinkyu Kim , Sangpil Kim