中文
相关论文

相关论文: From Continuity to Editability: Inverting GANs wit…

200 篇论文

With the recent advances in NeRF-based 3D aware GANs quality, projecting an image into the latent space of these 3D-aware GANs has a natural advantage over 2D GAN inversion: not only does it allow multi-view consistent editing of the…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Jaehoon Ko , Kyusun Cho , Daewon Choi , Kwangrok Ryoo , Seungryong Kim

Existing GAN inversion and editing methods work well for aligned objects with a clean background, such as portraits and animal faces, but often struggle for more difficult categories with complex scene layouts and object occlusions, such as…

计算机视觉与模式识别 · 计算机科学 2022-06-17 Gaurav Parmar , Yijun Li , Jingwan Lu , Richard Zhang , Jun-Yan Zhu , Krishna Kumar Singh

Generative Adversarial Networks (GANs) have recently demonstrated to successfully approximate complex data distributions. A relevant extension of this model is conditional GANs (cGANs), where the introduction of external information allows…

计算机视觉与模式识别 · 计算机科学 2016-11-22 Guim Perarnau , Joost van de Weijer , Bogdan Raducanu , Jose M. Álvarez

Recently, a surge of high-quality 3D-aware GANs have been proposed, which leverage the generative power of neural rendering. It is natural to associate 3D GANs with GAN inversion methods to project a real image into the generator's latent…

计算机视觉与模式识别 · 计算机科学 2023-03-15 Fei Yin , Yong Zhang , Xuan Wang , Tengfei Wang , Xiaoyu Li , Yuan Gong , Yanbo Fan , Xiaodong Cun , Ying Shan , Cengiz Oztireli , Yujiu Yang

Despite the demonstrated editing capacity in the latent space of a pretrained GAN model, inverting real-world images is stuck in a dilemma that the reconstruction cannot be faithful to the original input. The main reason for this is that…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Haorui Song , Yong Du , Tianyi Xiang , Junyu Dong , Jing Qin , Shengfeng He

While high fidelity and efficiency are central to the creation of digital head avatars, recent methods relying on 2D or 3D generative models often experience limitations such as shape distortion, expression inaccuracy, and identity…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Xiaochen Zhao , Jingxiang Sun , Lizhen Wang , Jinli Suo , Yebin Liu

Real-world image manipulation has achieved fantastic progress in recent years. GAN inversion, which aims to map the real image to the latent code faithfully, is the first step in this pipeline. However, existing GAN inversion methods fail…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Bangrui Jiang , Zhenhua Guo , Yujiu Yang

Despite the recent success of GANs in synthesizing images conditioned on inputs such as a user sketch, text, or semantic labels, manipulating the high-level attributes of an existing natural photograph with GANs is challenging for two…

计算机视觉与模式识别 · 计算机科学 2020-09-15 David Bau , Hendrik Strobelt , William Peebles , Jonas Wulff , Bolei Zhou , Jun-Yan Zhu , Antonio Torralba

Real-world image manipulation has achieved fantastic progress in recent years as a result of the exploration and utilization of GAN latent spaces. GAN inversion is the first step in this pipeline, which aims to map the real image to the…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Tan M. Dinh , Anh Tuan Tran , Rang Nguyen , Binh-Son Hua

For successful semantic editing of real images, it is critical for a GAN inversion method to find an in-domain latent code that aligns with the domain of a pre-trained GAN model. Unfortunately, such in-domain latent codes can be found only…

计算机视觉与模式识别 · 计算机科学 2021-08-23 Kyoungkook Kang , Seongtae Kim , Sunghyun Cho

Image inpainting seeks a semantically consistent way to recover the corrupted image in the light of its unmasked content. Previous approaches usually reuse the well-trained GAN as effective prior to generate realistic patches for missing…

计算机视觉与模式识别 · 计算机科学 2022-08-26 Yongsheng Yu , Libo Zhang , Heng Fan , Tiejian Luo

Intrinsic Image Decomposition (IID) is a challenging inverse problem that seeks to decompose a natural image into its underlying intrinsic components such as albedo and shading. While recent image decomposition methods rely on…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Viraj Shah , Svetlana Lazebnik , Julien Philip

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Kai Katsumata , Duc Minh Vo , Bei Liu , Hideki Nakayama

Existing GAN inversion methods fail to provide latent codes for reliable reconstruction and flexible editing simultaneously. This paper presents a transformer-based image inversion and editing model for pretrained StyleGAN which is not only…

计算机视觉与模式识别 · 计算机科学 2022-03-16 Xueqi Hu , Qiusheng Huang , Zhengyi Shi , Siyuan Li , Changxin Gao , Li Sun , Qingli Li

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit…

计算机视觉与模式识别 · 计算机科学 2023-07-19 Kai Katsumata , Duc Minh Vo , Bei Liu , Hideki Nakayama

Image outpainting seeks for a semantically consistent extension of the input image beyond its available content. Compared to inpainting -- filling in missing pixels in a way coherent with the neighboring pixels -- outpainting can be…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Yen-Chi Cheng , Chieh Hubert Lin , Hsin-Ying Lee , Jian Ren , Sergey Tulyakov , Ming-Hsuan Yang

Existing models for unsupervised image translation with Generative Adversarial Networks (GANs) can learn the mapping from the source domain to the target domain using a cycle-consistency loss. However, these methods always adopt a symmetric…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Hao Tang , Nicu Sebe

Contemporary benchmark methods for image inpainting are based on deep generative models and specifically leverage adversarial loss for yielding realistic reconstructions. However, these models cannot be directly applied on image/video…

计算机视觉与模式识别 · 计算机科学 2017-11-20 Avisek Lahiri , Arnav Jain , Prabir Kumar Biswas , Pabitra Mitra

GAN-based image restoration inverts the generative process to repair images corrupted by known degradations. Existing unsupervised methods must be carefully tuned for each task and degradation level. In this work, we make StyleGAN image…

计算机视觉与模式识别 · 计算机科学 2023-06-23 Yohan Poirier-Ginter , Jean-François Lalonde

Existing state-of-the-art techniques in exemplar-based image-to-image translation hold several critical concerns. Existing methods related to exemplar-based image-to-image translation are impossible to translate on an image tuple input…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Taewon Kang