English
Related papers

Related papers: AniPortraitGAN: Animatable 3D Portrait Generation …

200 papers

Generating realistic talking faces is an interesting and long-standing topic in the field of computer vision. Although significant progress has been made, it is still challenging to generate high-quality dynamic faces with personalized…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Bo Ding , Zhenfeng Fan , Shuang Yang , Shihong Xia

Over the years, 2D GANs have achieved great successes in photorealistic portrait generation. However, they lack 3D understanding in the generation process, thus they suffer from multi-view inconsistency problem. To alleviate the issue, many…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Jeong-gi Kwak , Yuanming Li , Dongsik Yoon , Donghyeon Kim , David Han , Hanseok Ko

Generative models have emerged as an essential building block for many image synthesis and editing tasks. Recent advances in this field have also enabled high-quality 3D or video content to be generated that exhibits either multi-view or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Hao Tang , Gordon Wetzstein , Leonidas Guibas , Luc Van Gool , Radu Timofte

In this paper, we investigate an open research task of generating 3D cartoon face shapes from single 2D GAN generated human faces and without 3D supervision, where we can also manipulate the facial expressions of the 3D shapes. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Hao Wang , Wenhao Shen , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

We propose a framework, called LiftedGAN, that disentangles and lifts a pre-trained StyleGAN2 for 3D-aware face generation. Our model is "3D-aware" in the sense that it is able to (1) disentangle the latent space of StyleGAN2 into texture,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Yichun Shi , Divyansh Aggarwal , Anil K. Jain

Recent advances in 3D-aware GAN models have enabled the generation of realistic and controllable human body images. However, existing methods focus on the control of major body joints, neglecting the manipulation of expressive attributes,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Zhongcong Xu , Jianfeng Zhang , Jun Hao Liew , Jiashi Feng , Mike Zheng Shou

To bring digital avatars into people's lives, it is highly demanded to efficiently generate complete, realistic, and animatable head avatars. This task is challenging, and it is difficult for existing methods to satisfy all the requirements…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Sijing Wu , Yichao Yan , Yunhao Li , Yuhao Cheng , Wenhan Zhu , Ke Gao , Xiaobo Li , Guangtao Zhai

Generating animatable and editable 3D head avatars is essential for various applications in computer vision and graphics. Traditional 3D-aware generative adversarial networks (GANs), often using implicit fields like Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Guohao Li , Hongyu Yang , Yifang Men , Di Huang , Weixin Li , Ruijie Yang , Yunhong Wang

Generative adversarial networks achieve great performance in photorealistic image synthesis in various domains, including human images. However, they usually employ latent vectors that encode the sampled outputs globally. This does not…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Kripasindhu Sarkar , Lingjie Liu , Vladislav Golyanik , Christian Theobalt

We present 3DHumanGAN, a 3D-aware generative adversarial network that synthesizes photorealistic images of full-body humans with consistent appearances under different view-angles and body-poses. To tackle the representational and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Zhuoqian Yang , Shikai Li , Wayne Wu , Bo Dai

Recently, Generative Adversarial Networks (GANs)} have been widely used for portrait image generation. However, in the latent space learned by GANs, different attributes, such as pose, shape, and texture style, are generally entangled,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Anpei Chen , Ruiyang Liu , Ling Xie , Zhang Chen , Hao Su , Jingyi Yu

Deep generative models learned through adversarial training have become increasingly popular for their ability to generate naturalistic image textures. However, aside from their texture, the visual appearance of objects is significantly…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Jean Kossaifi , Linh Tran , Yannis Panagakis , Maja Pantic

Differentiable rendering has paved the way to training neural networks to perform "inverse graphics" tasks such as predicting 3D geometry from monocular photographs. To train high performing models, most of the current approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Yuxuan Zhang , Wenzheng Chen , Huan Ling , Jun Gao , Yinan Zhang , Antonio Torralba , Sanja Fidler

Animating human face images aims to synthesize a desired source identity in a natural-looking way mimicking a driving video's facial movements. In this context, Generative Adversarial Networks have demonstrated remarkable potential in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Alireza Javanmardi , Alain Pagani , Didier Stricker

3D-aware image generative modeling aims to generate 3D-consistent images with explicitly controllable camera poses. Recent works have shown promising results by training neural radiance field (NeRF) generators on unstructured 2D images, but…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Yu Deng , Jiaolong Yang , Jianfeng Xiang , Xin Tong

Generation of photo-realistic images, semantic editing and representation learning are a few of many potential applications of high resolution generative models. Recent progress in GANs have established them as an excellent choice for such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Partha Ghosh , Dominik Zietlow , Michael J. Black , Larry S. Davis , Xiaochen Hu

Portrait stylization is a long-standing task enabling extensive applications. Although 2D-based methods have made great progress in recent years, real-world applications such as metaverse and games often demand 3D content. On the other…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Zhuo Chen , Xudong Xu , Yichao Yan , Ye Pan , Wenhan Zhu , Wayne Wu , Bo Dai , Xiaokang Yang

We present Dynamic Neural Portraits, a novel approach to the problem of full-head reenactment. Our method generates photo-realistic video portraits by explicitly controlling head pose, facial expressions and eye gaze. Our proposed…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Michail Christos Doukas , Stylianos Ploumpis , Stefanos Zafeiriou

We present a versatile model, FaceAnime, for various video generation tasks from still images. Video generation from a single face image is an interesting problem and usually tackled by utilizing Generative Adversarial Networks (GANs) to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Xiaoguang Tu , Yingtian Zou , Jian Zhao , Wenjie Ai , Jian Dong , Yuan Yao , Zhikang Wang , Guodong Guo , Zhifeng Li , Wei Liu , Jiashi Feng

Predominant techniques on talking head generation largely depend on 2D information, including facial appearances and motions from input face images. Nevertheless, dense 3D facial geometry, such as pixel-wise depth, plays a critical role in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Fa-Ting Hong , Li Shen , Dan Xu