中文
相关论文

相关论文: Cycle Encoding of a StyleGAN Encoder for Improved …

200 篇论文

StyleGAN2 was demonstrated to be a powerful image generation engine that supports semantic editing. However, in order to manipulate a real-world image, one first needs to be able to retrieve its corresponding latent representation in…

计算机视觉与模式识别 · 计算机科学 2023-02-23 Erez Sheffi , Michael Rotman , Lior Wolf

In StyleGAN, convolution kernels are shaped by both static parameters shared across images and dynamic modulation factors $w^+\in\mathcal{W}^+$ specific to each image. Therefore, $\mathcal{W}^+$ space is often used for image inversion and…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Siwei Xia , Xueqi Hu , Li Sun , Qingli Li

We present a novel image inversion framework and a training pipeline to achieve high-fidelity image inversion with high-quality attribute editing. Inverting real images into StyleGAN's latent space is an extensively studied problem, yet the…

计算机视觉与模式识别 · 计算机科学 2023-01-02 Hamza Pehlivan , Yusuf Dalva , Aysegul Dundar

The inversion of real images into StyleGAN's latent space is a well-studied problem. Nevertheless, applying existing approaches to real-world scenarios remains an open challenge, due to an inherent trade-off between reconstruction and…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Yuval Alaluf , Omer Tov , Ron Mokady , Rinon Gal , Amit H. Bermano

One of the main motivations for training high quality image generative models is their potential use as tools for image manipulation. Recently, generative adversarial networks (GANs) have been able to generate images of remarkable quality.…

计算机视觉与模式识别 · 计算机科学 2019-07-01 Aviv Gabbay , Yedid Hoshen

GAN-based image restoration inverts the generative process to repair images corrupted by known degradations. Existing unsupervised methods must be carefully tuned for each task and degradation level. In this work, we make StyleGAN image…

计算机视觉与模式识别 · 计算机科学 2023-06-23 Yohan Poirier-Ginter , Jean-François Lalonde

We present a generic image-to-image translation framework, pixel2style2pixel (pSp). Our pSp framework is based on a novel encoder network that directly generates a series of style vectors which are fed into a pretrained StyleGAN generator,…

计算机视觉与模式识别 · 计算机科学 2021-04-22 Elad Richardson , Yuval Alaluf , Or Patashnik , Yotam Nitzan , Yaniv Azar , Stav Shapiro , Daniel Cohen-Or

Generative Adversarial Networks (GANs) with style-based generators (e.g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by…

计算机视觉与模式识别 · 计算机科学 2020-11-20 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

Recent advanced GAN inversion models aim to convey high-fidelity information from original images to generators through methods using generator tuning or high-dimensional feature learning. Despite these efforts, accurately reconstructing…

计算机视觉与模式识别 · 计算机科学 2025-01-15 Chaewon Kim , Seung-Jun Moon , Gyeong-Moon Park

3D-aware GANs offer new capabilities for view synthesis while preserving the editing functionalities of their 2D counterparts. GAN inversion is a crucial step that seeks the latent code to reconstruct input images or videos, subsequently…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Yiran Xu , Zhixin Shu , Cameron Smith , Seoung Wug Oh , Jia-Bin Huang

For successful semantic editing of real images, it is critical for a GAN inversion method to find an in-domain latent code that aligns with the domain of a pre-trained GAN model. Unfortunately, such in-domain latent codes can be found only…

计算机视觉与模式识别 · 计算机科学 2021-08-23 Kyoungkook Kang , Seongtae Kim , Sunghyun Cho

With the recent advances in NeRF-based 3D aware GANs quality, projecting an image into the latent space of these 3D-aware GANs has a natural advantage over 2D GAN inversion: not only does it allow multi-view consistent editing of the…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Jaehoon Ko , Kyusun Cho , Daewon Choi , Kwangrok Ryoo , Seungryong Kim

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

计算机视觉与模式识别 · 计算机科学 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

Despite the success of Generative Adversarial Networks (GANs) in image synthesis, applying trained GAN models to real image processing remains challenging. Previous methods typically invert a target image back to the latent space either by…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Jinjin Gu , Yujun Shen , Bolei Zhou

To edit a real photo using Generative Adversarial Networks (GANs), we need a GAN inversion algorithm to identify the latent vector that perfectly reproduces it. Unfortunately, whereas existing inversion algorithms can synthesize images…

计算机视觉与模式识别 · 计算机科学 2022-02-25 Qianli Feng , Viraj Shah , Raghudeep Gadde , Pietro Perona , Aleix Martinez

Generation of photo-realistic images, semantic editing and representation learning are a few of many potential applications of high resolution generative models. Recent progress in GANs have established them as an excellent choice for such…

计算机视觉与模式识别 · 计算机科学 2021-12-13 Partha Ghosh , Dominik Zietlow , Michael J. Black , Larry S. Davis , Xiaochen Hu

Generative Adversarial Network (GAN) inversion have demonstrated excellent performance in image inpainting that aims to restore lost or damaged image texture using its unmasked content. Previous GAN inversion-based methods usually utilize…

计算机视觉与模式识别 · 计算机科学 2025-04-18 Libo Zhang , Yongsheng Yu , Jiali Yao , Heng Fan

Image inversion is a fundamental task in generative models, aiming to map images back to their latent representations to enable downstream applications such as editing, restoration, and style transfer. This paper provides a comprehensive…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Yinan Chen , Jiangning Zhang , Yali Bi , Xiaobin Hu , Teng Hu , Zhucun Xue , Ran Yi , Yong Liu , Ying Tai

Unpaired Image-to-Image translation aims to convert the image from one domain (input domain A) to another domain (target domain B), without providing paired examples for the training. The state-of-the-art, Cycle-GAN demonstrated the power…

计算机视觉与模式识别 · 计算机科学 2018-02-14 Mohan Nikam

We tackle the task of NeRF inversion for style-based neural radiance fields, (e.g., StyleNeRF). In the task, we aim to learn an inversion function to project an input image to the latent space of a NeRF generator and then synthesize novel…

计算机视觉与模式识别 · 计算机科学 2022-11-15 Yu-Jhe Li , Tao Xu , Bichen Wu , Ningyuan Zheng , Xiaoliang Dai , Albert Pumarola , Peizhao Zhang , Peter Vajda , Kris Kitani