中文
相关论文

相关论文: Lifting 2D StyleGAN for 3D-Aware Face Generation

200 篇论文

Efficiently generating a freestyle 3D portrait with high quality and 3D-consistency is a promising yet challenging task. The portrait styles generated by most existing methods are usually restricted by their 3D generators, which are learned…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Tianxiang Ma , Kang Zhao , Jianxin Sun , Yingya Zhang , Jing Dong

Although significant progress has been made in synthesizing high-quality and visually realistic face images by unconditional Generative Adversarial Networks (GANs), there still lacks of control over the generation process in order to…

计算机视觉与模式识别 · 计算机科学 2020-12-23 Xianxu Hou , Xiaokang Zhang , Linlin Shen , Zhihui Lai , Jun Wan

Over the years, 2D GANs have achieved great successes in photorealistic portrait generation. However, they lack 3D understanding in the generation process, thus they suffer from multi-view inconsistency problem. To alleviate the issue, many…

计算机视觉与模式识别 · 计算机科学 2022-07-27 Jeong-gi Kwak , Yuanming Li , Dongsik Yoon , Donghyeon Kim , David Han , Hanseok Ko

The advancement of generative radiance fields has pushed the boundary of 3D-aware image synthesis. Motivated by the observation that a 3D object should look realistic from multiple viewpoints, these methods introduce a multi-view constraint…

计算机视觉与模式识别 · 计算机科学 2021-12-10 Xingang Pan , Xudong Xu , Chen Change Loy , Christian Theobalt , Bo Dai

Learning disentangled representations of data is a fundamental problem in artificial intelligence. Specifically, disentangled latent representations allow generative models to control and compose the disentangled factors in the synthesis…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Yotam Nitzan , Amit Bermano , Yangyan Li , Daniel Cohen-Or

In this paper, we investigate an open research task of generating 3D cartoon face shapes from single 2D GAN generated human faces and without 3D supervision, where we can also manipulate the facial expressions of the 3D shapes. To this end,…

计算机视觉与模式识别 · 计算机科学 2025-05-15 Hao Wang , Wenhao Shen , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

While recent 3D-aware generative models have shown photo-realistic image synthesis with multi-view consistency, the synthesized image quality degrades depending on the camera pose (e.g., a face with a blurry and noisy boundary at a side…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Kyungmin Jo , Wonjoon Jin , Jaegul Choo , Hyunjoon Lee , Sunghyun Cho

In this work we introduce Lifting Autoencoders, a generative 3D surface-based model of object categories. We bring together ideas from non-rigid structure from motion, image formation, and morphable models to learn a controllable, geometric…

计算机视觉与模式识别 · 计算机科学 2019-04-29 Mihir Sahasrabudhe , Zhixin Shu , Edward Bartrum , Riza Alp Guler , Dimitris Samaras , Iasonas Kokkinos

We present Free-HeadGAN, a person-generic neural talking head synthesis system. We show that modeling faces with sparse 3D facial landmarks are sufficient for achieving state-of-the-art generative performance, without relying on strong…

计算机视觉与模式识别 · 计算机科学 2022-08-04 Michail Christos Doukas , Evangelos Ververas , Viktoriia Sharmanska , Stefanos Zafeiriou

Unsupervised learning of 3D-aware generative adversarial networks (GANs) using only collections of single-view 2D photographs has very recently made much progress. These 3D GANs, however, have not been demonstrated for human bodies and the…

计算机视觉与模式识别 · 计算机科学 2023-01-10 Alexander W. Bergman , Petr Kellnhofer , Wang Yifan , Eric R. Chan , David B. Lindell , Gordon Wetzstein

Unsupervised learning of 3D human faces from unstructured 2D image data is an active research area. While recent works have achieved an impressive level of photorealism, they commonly lack control of lighting, which prevents the generated…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Boyang Deng , Yifan Wang , Gordon Wetzstein

In contrast to the traditional avatar creation pipeline which is a costly process, contemporary generative approaches directly learn the data distribution from photographs. While plenty of works extend unconditional generative models and…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Junshu Tang , Bo Zhang , Binxin Yang , Ting Zhang , Dong Chen , Lizhuang Ma , Fang Wen

We present 3DHumanGAN, a 3D-aware generative adversarial network that synthesizes photorealistic images of full-body humans with consistent appearances under different view-angles and body-poses. To tackle the representational and…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Zhuoqian Yang , Shikai Li , Wayne Wu , Bo Dai

3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Jingxiang Sun , Xuan Wang , Lizhen Wang , Xiaoyu Li , Yong Zhang , Hongwen Zhang , Yebin Liu

We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Animesh Karnewar , Oliver Wang , Tobias Ritschel , Niloy Mitra

StyleGAN has achieved great progress in 2D face reconstruction and semantic editing via image inversion and latent editing. While studies over extending 2D StyleGAN to 3D faces have emerged, a corresponding generic 3D GAN inversion…

计算机视觉与模式识别 · 计算机科学 2022-12-19 Yushi Lan , Xuyi Meng , Shuai Yang , Chen Change Loy , Bo Dai

We introduce PlatonicGAN to discover the 3D structure of an object class from an unstructured collection of 2D images, i.e., where no relation between photos is known, except that they are showing instances of the same category. The key…

计算机视觉与模式识别 · 计算机科学 2021-06-11 Philipp Henzler , Niloy Mitra , Tobias Ritschel

We present a StyleGAN2-based deep learning approach for 3D shape generation, called SDF-StyleGAN, with the aim of reducing visual and geometric dissimilarity between generated shapes and a shape collection. We extend StyleGAN2 to 3D…

计算机视觉与模式识别 · 计算机科学 2022-06-27 Xin-Yang Zheng , Yang Liu , Peng-Shuai Wang , Xin Tong

Generative Neural Radiance Field (GNeRF) models, which extract implicit 3D representations from 2D images, have recently been shown to produce realistic images representing rigid/semi-rigid objects, such as human faces or cars. However,…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Jichao Zhang , Enver Sangineto , Hao Tang , Aliaksandr Siarohin , Zhun Zhong , Nicu Sebe , Wei Wang

While substantial progresses have been made in automated 2D portrait stylization, admirable 3D portrait stylization from a single user photo remains to be an unresolved challenge. One primary obstacle here is the lack of high quality…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Guoxian Song , Hongyi Xu , Jing Liu , Tiancheng Zhi , Yichun Shi , Jianfeng Zhang , Zihang Jiang , Jiashi Feng , Shen Sang , Linjie Luo