中文
相关论文

相关论文: Overparameterization Improves StyleGAN Inversion

200 篇论文

Recent studies have shown that StyleGANs provide promising prior models for downstream tasks on image synthesis and editing. However, since the latent codes of StyleGANs are designed to control global styles, it is hard to achieve a…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Yichun Shi , Xiao Yang , Yangyue Wan , Xiaohui Shen

Recently, the power of unconditional image synthesis has significantly advanced through the use of Generative Adversarial Networks (GANs). The task of inverting an image into its corresponding latent code of the trained GAN is of utmost…

计算机视觉与模式识别 · 计算机科学 2021-08-25 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator. Embedding a given image back to the latent space of StyleGAN enables wide interesting semantic…

计算机视觉与模式识别 · 计算机科学 2020-07-06 Shanyan Guan , Ying Tai , Bingbing Ni , Feida Zhu , Feiyue Huang , Xiaokang Yang

In StyleGAN, convolution kernels are shaped by both static parameters shared across images and dynamic modulation factors $w^+\in\mathcal{W}^+$ specific to each image. Therefore, $\mathcal{W}^+$ space is often used for image inversion and…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Siwei Xia , Xueqi Hu , Li Sun , Qingli Li

GAN inversion aims to invert an input image into the latent space of a pre-trained GAN. Despite the recent advances in GAN inversion, there remain challenges to mitigate the tradeoff between distortion and editability, i.e. reconstructing…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Xudong Mao , Liujuan Cao , Aurele T. Gnanha , Zhenguo Yang , Qing Li , Rongrong Ji

Inverting a Generative Adversarial Network (GAN) facilitates a wide range of image editing tasks using pre-trained generators. Existing methods typically employ the latent space of GANs as the inversion space yet observe the insufficient…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Qingyan Bai , Yinghao Xu , Jiapeng Zhu , Weihao Xia , Yujiu Yang , Yujun Shen

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

计算机视觉与模式识别 · 计算机科学 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

Current methods for image-to-image translation produce compelling results, however, the applied transformation is difficult to control, since existing mechanisms are often limited and non-intuitive. We propose ParGAN, a generalization of…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Diego Martin Arroyo , Alessio Tonioni , Federico Tombari

Real-world image manipulation has achieved fantastic progress in recent years. GAN inversion, which aims to map the real image to the latent code faithfully, is the first step in this pipeline. However, existing GAN inversion methods fail…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Bangrui Jiang , Zhenhua Guo , Yujiu Yang

Editing of portrait images is a very popular and important research topic with a large variety of applications. For ease of use, control should be provided via a semantically meaningful parameterization that is akin to computer animation…

计算机视觉与模式识别 · 计算机科学 2020-09-22 Ayush Tewari , Mohamed Elgharib , Mallikarjun B R. , Florian Bernard , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

Generative Adversarial Networks (GANs) have established themselves as a prevalent approach to image synthesis. Of these, StyleGAN offers a fascinating case study, owing to its remarkable visual quality and an ability to support a large…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Amit H. Bermano , Rinon Gal , Yuval Alaluf , Ron Mokady , Yotam Nitzan , Omer Tov , Or Patashnik , Daniel Cohen-Or

Despite recent advances in semantic manipulation using StyleGAN, semantic editing of real faces remains challenging. The gap between the $W$ space and the $W$+ space demands an undesirable trade-off between reconstruction quality and…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Heyi Li , Jinlong Liu , Xinyu Zhang , Yunzhi Bai , Huayan Wang , Klaus Mueller

Despite the success of Generative Adversarial Networks (GANs) in image synthesis, applying trained GAN models to real image processing remains challenging. Previous methods typically invert a target image back to the latent space either by…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Jinjin Gu , Yujun Shen , Bolei Zhou

StyleGAN is arguably one of the most intriguing and well-studied generative models, demonstrating impressive performance in image generation, inversion, and manipulation. In this work, we explore the recent StyleGAN3 architecture, compare…

计算机视觉与模式识别 · 计算机科学 2022-02-01 Yuval Alaluf , Or Patashnik , Zongze Wu , Asif Zamir , Eli Shechtman , Dani Lischinski , Daniel Cohen-Or

We propose Image2StyleGAN++, a flexible image editing framework with many applications. Our framework extends the recent Image2StyleGAN in three ways. First, we introduce noise optimization as a complement to the $W^+$ latent space…

计算机视觉与模式识别 · 计算机科学 2020-08-10 Rameen Abdal , Yipeng Qin , Peter Wonka

We propose an efficient algorithm to embed a given image into the latent space of StyleGAN. This embedding enables semantic image editing operations that can be applied to existing photographs. Taking the StyleGAN trained on the FFHQ…

计算机视觉与模式识别 · 计算机科学 2019-09-05 Rameen Abdal , Yipeng Qin , Peter Wonka

Recent advances in the field of generative models and in particular generative adversarial networks (GANs) have lead to substantial progress for controlled image editing, especially compared with the pre-deep learning era. Despite their…

计算机视觉与模式识别 · 计算机科学 2023-12-14 Gwilherm Lesné , Yann Gousseau , Saïd Ladjal , Alasdair Newson

Computed medical imaging systems require a computational reconstruction procedure for image formation. In order to recover a useful estimate of the object to-be-imaged when the recorded measurements are incomplete, prior knowledge about the…

图像与视频处理 · 电气工程与系统科学 2022-02-21 Varun A. Kelkar , Mark A. Anastasio

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

计算机视觉与模式识别 · 计算机科学 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

We resolve the ill-posed alpha matting problem from a completely different perspective. Given an input portrait image, instead of estimating the corresponding alpha matte, we focus on the other end, to subtly enhance this input so that the…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Yangyang Xu Zeyang Zhou , Shengfeng He