English
Related papers

Related papers: Designing a 3D-Aware StyleNeRF Encoder for Face Ed…

200 papers

A lot of work has been done towards reconstructing the 3D facial structure from single images by capitalizing on the power of Deep Convolutional Neural Networks (DCNNs). In the recent works, the texture features either correspond to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Baris Gecer , Stylianos Ploumpis , Irene Kotsia , Stefanos Zafeiriou

We introduce a highly robust GAN-based framework for digitizing a normalized 3D avatar of a person from a single unconstrained photo. While the input image can be of a smiling person or taken in extreme lighting conditions, our method can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Huiwen Luo , Koki Nagano , Han-Wei Kung , Mclean Goldwhite , Qingguo Xu , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li

Most 3D shape completion approaches rely heavily on partial-complete shape pairs and learn in a fully supervised manner. Despite their impressive performances on in-domain data, when generalizing to partial shapes in other forms or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Junzhe Zhang , Xinyi Chen , Zhongang Cai , Liang Pan , Haiyu Zhao , Shuai Yi , Chai Kiat Yeo , Bo Dai , Chen Change Loy

Recent research has shown that controllable image generation based on pre-trained GANs can benefit a wide range of computer vision tasks. However, less attention has been devoted to 3D vision tasks. In light of this, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Feng Liu , Xiaoming Liu

Generating animatable and editable 3D head avatars is essential for various applications in computer vision and graphics. Traditional 3D-aware generative adversarial networks (GANs), often using implicit fields like Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Guohao Li , Hongyu Yang , Yifang Men , Di Huang , Weixin Li , Ruijie Yang , Yunhong Wang

Recently, there has been a surge of diverse methods for performing image editing by employing pre-trained unconditional generators. Applying these methods on real images, however, remains a challenge, as it necessarily requires the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Omer Tov , Yuval Alaluf , Yotam Nitzan , Or Patashnik , Daniel Cohen-Or

Unsupervised learning of 3D-aware generative adversarial networks (GANs) using only collections of single-view 2D photographs has very recently made much progress. These 3D GANs, however, have not been demonstrated for human bodies and the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Alexander W. Bergman , Petr Kellnhofer , Wang Yifan , Eric R. Chan , David B. Lindell , Gordon Wetzstein

Recently, we have witnessed the explosive growth of various volumetric representations in modeling animatable head avatars. However, due to the diversity of frameworks, there is no practical method to support high-level applications like 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chong Bao , Yinda Zhang , Yuan Li , Xiyu Zhang , Bangbang Yang , Hujun Bao , Marc Pollefeys , Guofeng Zhang , Zhaopeng Cui

Existing GAN inversion and editing methods work well for aligned objects with a clean background, such as portraits and animal faces, but often struggle for more difficult categories with complex scene layouts and object occlusions, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Gaurav Parmar , Yijun Li , Jingwan Lu , Richard Zhang , Jun-Yan Zhu , Krishna Kumar Singh

3D face editing is a significant task in multimedia, aimed at the manipulation of 3D face models across various control signals. The success of 3D-aware GAN provides expressive 3D models learned from 2D single-view images only, encouraging…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Zhuo Chen , Yichao Yan , Sehngqi Liu , Yuhao Cheng , Weiming Zhao , Lincheng Li , Mengxiao Bi , Xiaokang Yang

Text-guided domain adaptation and generation of 3D-aware portraits find many applications in various fields. However, due to the lack of training data and the challenges in handling the high variety of geometry and appearance, the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Biwen Lei , Kai Yu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

Nerf-based Generative models have shown impressive capacity in generating high-quality images with consistent 3D geometry. Despite successful synthesis of fake identity images randomly sampled from latent space, adopting these models for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yu Yin , Kamran Ghasedi , HsiangTao Wu , Jiaolong Yang , Xin Tong , Yun Fu

Neuroscience studies have revealed that the brain encodes visual content and embeds information in neural activity. Recently, deep learning techniques have facilitated attempts to address visual reconstructions by mapping brain activity to…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Pei-Chun Chang , Yan-Yu Tien , Chia-Lin Chen , Li-Fen Chen , Yong-Sheng Chen , Hui-Ling Chan

The privacy and security of face data on social media are facing unprecedented challenges as it is vulnerable to unauthorized access and identification. A common practice for solving this problem is to modify the original data so that it…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yueming Lyu , Yue Jiang , Ziwen He , Bo Peng , Yunfan Liu , Jing Dong

While 3D GANs have recently demonstrated the high-quality synthesis of multi-view consistent images and 3D shapes, they are mainly restricted to photo-realistic human portraits. This paper aims to extend 3D GANs to a different, but…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Wonjoon Jin , Nuri Ryu , Geonung Kim , Seung-Hwan Baek , Sunghyun Cho

The ability to create high-quality 3D faces from a single image has become increasingly important with wide applications in video conferencing, AR/VR, and advanced video editing in movie industries. In this paper, we propose Face Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Hao Zhang , Yanbo Xu , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

Semantic facial attribute editing using pre-trained Generative Adversarial Networks (GANs) has attracted a great deal of attention and effort from researchers in recent years. Due to the high quality of face images generated by StyleGANs,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Najmeh Mohammadbagheri , Fardin Ayar , Ahmad Nickabadi , Reza Safabakhsh

Unpaired image-to-image translation using Generative Adversarial Networks (GAN) is successful in converting images among multiple domains. Moreover, recent studies have shown a way to diversify the outputs of the generator. However, since…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Sho Inoue , Tad Gonsalves

We propose StyleNeRF, a 3D-aware generative model for photo-realistic high-resolution image synthesis with high multi-view consistency, which can be trained on unstructured 2D images. Existing approaches either cannot synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jiatao Gu , Lingjie Liu , Peng Wang , Christian Theobalt

In the past few years, a lot of work has been done towards reconstructing the 3D facial structure from single images by capitalizing on the power of Deep Convolutional Neural Networks (DCNNs). In the most recent works, differentiable…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Baris Gecer , Stylianos Ploumpis , Irene Kotsia , Stefanos Zafeiriou