English
Related papers

Related papers: Make Encoder Great Again in 3D GAN Inversion throu…

200 papers

Recent progress in NeRF-based GANs has introduced a number of approaches for high-resolution and high-fidelity generative modeling of human heads with a possibility for novel view rendering. At the same time, one must solve an inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ananta R. Bhattarai , Matthias Nießner , Artem Sevastopolsky

3D GAN inversion aims to project a single image into the latent space of a 3D Generative Adversarial Network (GAN), thereby achieving 3D geometry reconstruction. While there exist encoders that achieve good results in 3D GAN inversion, they…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Bahri Batuhan Bilecen , Ahmet Berke Gokmen , Aysegul Dundar

StyleGAN has achieved great progress in 2D face reconstruction and semantic editing via image inversion and latent editing. While studies over extending 2D StyleGAN to 3D faces have emerged, a corresponding generic 3D GAN inversion…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Yushi Lan , Xuyi Meng , Shuai Yang , Chen Change Loy , Bo Dai

With the recent advances in NeRF-based 3D aware GANs quality, projecting an image into the latent space of these 3D-aware GANs has a natural advantage over 2D GAN inversion: not only does it allow multi-view consistent editing of the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Jaehoon Ko , Kyusun Cho , Daewon Choi , Kwangrok Ryoo , Seungryong Kim

GAN inversion has been exploited in many face manipulation tasks, but 2D GANs often fail to generate multi-view 3D consistent images. The encoders designed for 2D GANs are not able to provide sufficient 3D information for the inversion and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Songlin Yang , Wei Wang , Bo Peng , Jing Dong

We propose a novel architecture for GAN inversion, which we call Feature-Style encoder. The style encoder is key for the manipulation of the obtained latent codes, while the feature encoder is crucial for optimal image reconstruction. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

Generative adversarial networks (GANs) can synthesize high-quality (HQ) images, and GAN inversion is a technique that discovers how to invert given images back to latent space. While existing methods perform on StyleGAN inversion, they have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Cheng Yu , Wenmin Wang , Roberto Bugiolacchi

3D-aware GANs offer new capabilities for view synthesis while preserving the editing functionalities of their 2D counterparts. GAN inversion is a crucial step that seeks the latent code to reconstruct input images or videos, subsequently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yiran Xu , Zhixin Shu , Cameron Smith , Seoung Wug Oh , Jia-Bin Huang

Generative Adversarial Networks (GANs) have significantly advanced image synthesis through mapping randomly sampled latent codes to high-fidelity synthesized images. However, applying well-trained GANs to real image editing remains…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiapeng Zhu , Yujun Shen , Yinghao Xu , Deli Zhao , Qifeng Chen , Bolei Zhou

Recently, a surge of high-quality 3D-aware GANs have been proposed, which leverage the generative power of neural rendering. It is natural to associate 3D GANs with GAN inversion methods to project a real image into the generator's latent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Fei Yin , Yong Zhang , Xuan Wang , Tengfei Wang , Xiaoyu Li , Yuan Gong , Yanbo Fan , Xiaodong Cun , Ying Shan , Cengiz Oztireli , Yujiu Yang

GAN inversion aims to invert an input image into the latent space of a pre-trained GAN. Despite the recent advances in GAN inversion, there remain challenges to mitigate the tradeoff between distortion and editability, i.e. reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Xudong Mao , Liujuan Cao , Aurele T. Gnanha , Zhenguo Yang , Qing Li , Rongrong Ji

GAN inversion aims to invert a given image back into the latent space of a pretrained GAN model, for the image to be faithfully reconstructed from the inverted code by the generator. As an emerging technique to bridge the real and fake…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Weihao Xia , Yulun Zhang , Yujiu Yang , Jing-Hao Xue , Bolei Zhou , Ming-Hsuan Yang

Recovering a textured 3D mesh from a monocular image is highly challenging, particularly for in-the-wild objects that lack 3D ground truths. In this work, we present MeshInversion, a novel framework to improve the reconstruction by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Junzhe Zhang , Daxuan Ren , Zhongang Cai , Chai Kiat Yeo , Bo Dai , Chen Change Loy

Real-world image manipulation has achieved fantastic progress in recent years. GAN inversion, which aims to map the real image to the latent code faithfully, is the first step in this pipeline. However, existing GAN inversion methods fail…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Bangrui Jiang , Zhenhua Guo , Yujiu Yang

Recently, there has been a surge of diverse methods for performing image editing by employing pre-trained unconditional generators. Applying these methods on real images, however, remains a challenge, as it necessarily requires the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Omer Tov , Yuval Alaluf , Yotam Nitzan , Or Patashnik , Daniel Cohen-Or

We study the 3D-aware image attribute editing problem in this paper, which has wide applications in practice. Recent methods solved the problem by training a shared encoder to map images into a 3D generator's latent space or by per-image…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Jianhui Li , Jianmin Li , Haoji Zhang , Shilong Liu , Zhengyi Wang , Zihao Xiao , Kaiwen Zheng , Jun Zhu

3D-aware image synthesis aims at learning a generative model that can render photo-realistic 2D images while capturing decent underlying 3D shapes. A popular solution is to adopt the generative adversarial network (GAN) and replace the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zifan Shi , Yinghao Xu , Yujun Shen , Deli Zhao , Qifeng Chen , Dit-Yan Yeung

Real-world image manipulation has achieved fantastic progress in recent years as a result of the exploration and utilization of GAN latent spaces. GAN inversion is the first step in this pipeline, which aims to map the real image to the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tan M. Dinh , Anh Tuan Tran , Rang Nguyen , Binh-Son Hua

Recently, the power of unconditional image synthesis has significantly advanced through the use of Generative Adversarial Networks (GANs). The task of inverting an image into its corresponding latent code of the trained GAN is of utmost…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

Inverting a Generative Adversarial Network (GAN) facilitates a wide range of image editing tasks using pre-trained generators. Existing methods typically employ the latent space of GANs as the inversion space yet observe the insufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Qingyan Bai , Yinghao Xu , Jiapeng Zhu , Weihao Xia , Yujiu Yang , Yujun Shen
‹ Prev 1 2 3 10 Next ›