English
Related papers

Related papers: Fast Text-to-3D-Aware Face Generation and Manipula…

200 papers

Despite significant recent advances in the field of face recognition, implementing face verification and recognition efficiently at scale presents serious challenges to current approaches. In this paper we present a system, called FaceNet,…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Florian Schroff , Dmitry Kalenichenko , James Philbin

Creating realistic 3D head assets for virtual characters that match a precise artistic vision remains labor-intensive. We present a novel framework that streamlines this process by providing artists with intuitive control over generated 3D…

Text-guided domain adaptation and generation of 3D-aware portraits find many applications in various fields. However, due to the lack of training data and the challenges in handling the high variety of geometry and appearance, the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Biwen Lei , Kai Yu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

The recent availability and adaptability of text-to-image models has sparked a new era in many related domains that benefit from the learned text priors as well as high-quality and fast generation capabilities, one of which is texture…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Raphael Bensadoun , Yanir Kleiman , Idan Azuri , Omri Harosh , Andrea Vedaldi , Natalia Neverova , Oran Gafni

Generative AI has made significant progress in recent years, with text-guided content generation being the most practical as it facilitates interaction between human instructions and AI-generated content (AIGC). Thanks to advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Chenghao Li , Chaoning Zhang , Joseph Cho , Atish Waghwase , Lik-Hang Lee , Francois Rameau , Yang Yang , Sung-Ho Bae , Choong Seon Hong

In this paper, we present FaceTuneGAN, a new 3D face model representation decomposing and encoding separately facial identity and facial expression. We propose a first adaptation of image-to-image translation networks, that have…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Nicolas Olivier , Kelian Baert , Fabien Danieau , Franck Multon , Quentin Avril

Face completion is a challenging generation task because it requires generating visually pleasing new pixels that are semantically consistent with the unmasked face region. This paper proposes a geometry-aware Face Completion and Editing…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Linsen Song , Jie Cao , Linxiao Song , Yibo Hu , Ran He

Text-to-3D generation from a single-view image is a popular but challenging task in 3D vision. Although numerous methods have been proposed, existing works still suffer from the inconsistency issues, including 1) semantic inconsistency, 2)…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Yichen Ouyang , Wenhao Chai , Jiayi Ye , Dapeng Tao , Yibing Zhan , Gaoang Wang

Automatic 3D facial texture generation has gained significant interest recently. Existing approaches may not support the traditional physically based rendering pipeline or rely on 3D data captured by Light Stage. Our key contribution is a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chi Wang , Junming Huang , Rong Zhang , Qi Wang , Haotian Yang , Haibin Huang , Chongyang Ma , Weiwei Xu

This paper presents FSNet, a deep generative model for image-based face swapping. Traditionally, face-swapping methods are based on three-dimensional morphable models (3DMMs), and facial textures are replaced between the estimated…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Ryota Natsume , Tatsuya Yatagawa , Shigeo Morishima

Emerging Metaverse applications demand accessible, accurate, and easy-to-use tools for 3D digital human creations in order to depict different cultures and societies as if in the physical world. Recent large-scale vision-language advances…

Graphics · Computer Science 2023-04-07 Longwen Zhang , Qiwei Qiu , Hongyang Lin , Qixuan Zhang , Cheng Shi , Wei Yang , Ye Shi , Sibei Yang , Lan Xu , Jingyi Yu

Synthesizing high-quality 3D face models from natural language descriptions is very valuable for many applications, including avatar creation, virtual reality, and telepresence. However, little research ever tapped into this task. We argue…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Menghua Wu , Hao Zhu , Linjia Huang , Yiyu Zhuang , Yuanxun Lu , Xun Cao

GAN inversion has been exploited in many face manipulation tasks, but 2D GANs often fail to generate multi-view 3D consistent images. The encoders designed for 2D GANs are not able to provide sufficient 3D information for the inversion and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Songlin Yang , Wei Wang , Bo Peng , Jing Dong

We introduce a method for learning to generate the surface of 3D shapes. Our approach represents a 3D shape as a collection of parametric surface elements and, in contrast to methods generating voxel grids or point clouds, naturally infers…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Thibault Groueix , Matthew Fisher , Vladimir G. Kim , Bryan C. Russell , Mathieu Aubry

A lot of work has been done towards reconstructing the 3D facial structure from single images by capitalizing on the power of Deep Convolutional Neural Networks (DCNNs). In the recent works, the texture features either correspond to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Baris Gecer , Stylianos Ploumpis , Irene Kotsia , Stefanos Zafeiriou

Due to the lack of large-scale text-3D correspondence data, recent text-to-3D generation works mainly rely on utilizing 2D diffusion models for synthesizing 3D data. Since diffusion-based methods typically require significant optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Bin-Shih Wu , Hong-En Chen , Sheng-Yu Huang , Yu-Chiang Frank Wang

As several industries are moving towards modeling massive 3D virtual worlds, the need for content creation tools that can scale in terms of the quantity, quality, and diversity of 3D content is becoming evident. In our work, we aim to train…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Jun Gao , Tianchang Shen , Zian Wang , Wenzheng Chen , Kangxue Yin , Daiqing Li , Or Litany , Zan Gojcic , Sanja Fidler

Monocular 3D facial shape reconstruction from a single 2D facial image has been an active research area due to its wide applications. Inspired by the success of deep neural networks (DNN), we propose a DNN-based approach for End-to-End 3D…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Pengfei Dou , Shishir K. Shah , Ioannis A. Kakadiaris

Current auto-regressive mesh generation methods suffer from issues such as incompleteness, insufficient detail, and poor generalization. In this paper, we propose an Auto-regressive Auto-encoder (ArAE) model capable of generating…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Jiaxiang Tang , Zhaoshuo Li , Zekun Hao , Xian Liu , Gang Zeng , Ming-Yu Liu , Qinsheng Zhang

We describe a deep learning based method for estimating 3D facial expression coefficients. Unlike previous work, our process does not relay on facial landmark detection methods as a proxy step. Recent methods have shown that a CNN can be…

Computer Vision and Pattern Recognition · Computer Science 2018-02-05 Feng-Ju Chang , Anh Tuan Tran , Tal Hassner , Iacopo Masi , Ram Nevatia , Gerard Medioni