English
Related papers

Related papers: Learning to Generate Customized Dynamic 3D Facial …

200 papers

Automatic mesh-based shape generation is of great interest across a wide range of disciplines, from industrial design to gaming, computer graphics and various other forms of digital art. While most traditional methods focus on primitive…

Graphics · Computer Science 2017-09-25 Chiyu "Max" Jiang , Philip Marcus

We present a single-image 3D face synthesis technique that can handle challenging facial expressions while recovering fine geometric details. Our technique employs expression analysis for proxy face geometry generation and combines…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Anpei Chen , Zhang Chen , Guli Zhang , Ziheng Zhang , Kenny Mitchell , Jingyi Yu

Speech-driven 3D facial animation aims at generating facial movements that are synchronized with the driving speech, which has been widely explored recently. Existing works mostly neglect the person-specific talking style in generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Liyang Chen , Weihong Bao , Shun Lei , Boshi Tang , Zhiyong Wu , Shiyin Kang , Haozhi Huang , Helen Meng

2D portrait animation has experienced significant advancements in recent years. Much research has utilized the prior knowledge embedded in large generative diffusion models to enhance high-quality image manipulation. However, most methods…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Xinya Ji , Gaspard Zoss , Prashanth Chandran , Lingchen Yang , Xun Cao , Barbara Solenthaler , Derek Bradley

Recently, talking-face video generation has received considerable attention. So far most methods generate results with neutral expressions or expressions that are implicitly determined by neural networks in an uncontrollable way. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Zipeng Ye , Zhiyao Sun , Yu-Hui Wen , Yanan Sun , Tian Lv , Ran Yi , Yong-Jin Liu

Facial 3D Morphable Models are a main computer vision subject with countless applications and have been highly optimized in the last two decades. The tremendous improvements of deep generative networks have created various possibilities for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Stathis Galanakis , Baris Gecer , Alexandros Lattas , Stefanos Zafeiriou

Facial expressions are one of the most powerful ways for depicting specific patterns in human behavior and describing human emotional state. Despite the impressive advances of affective computing over the last decade, automatic video-based…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Thomas Teixeira , Eric Granger , Alessandro Lameiras Koerich

In this paper, we proposed a generative model that learns to synthesize the 4D facial expression with the neutral landmark. Existing works mainly focus on the generation of sequences guided by expression labels, speech, etc, while they are…

Graphics · Computer Science 2026-03-12 Xin Lu , Zhengda Lu , Yiqun Wang , Jun Xiao

Recent advances in deep generative models have demonstrated impressive results in photo-realistic facial image synthesis and editing. Facial expressions are inherently the result of muscle movement. However, existing neural network-based…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 ShahRukh Athar , Zhixin Shu , Dimitris Samaras

This report surveys advances in deep learning-based modeling techniques that address four different 3D indoor scene analysis tasks, as well as synthesis of 3D indoor scenes. We describe different kinds of representations for indoor scenes,…

Graphics · Computer Science 2023-08-22 Akshay Gadi Patil , Supriya Gadi Patil , Manyi Li , Matthew Fisher , Manolis Savva , Hao Zhang

Creating realistic animations of human faces with computer graphic models is still a challenging task. It is often solved either with tedious manual work or motion capture based techniques that require specialised and costly hardware.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Wolfgang Paier , Anna Hilsmann , Peter Eisert

Speech-driven 3D facial animation synthesis has been a challenging task both in industry and research. Recent methods mostly focus on deterministic deep learning methods meaning that given a speech input, the output is always the same.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Stefan Stan , Kazi Injamamul Haque , Zerrin Yumak

Facial expression editing methods can be mainly categorized into two types based on their architectures: 2D-based and 3D-based methods. The former lacks 3D face modeling capabilities, making it difficult to edit 3D factors effectively. The…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yikang He , Jichao Zhang , Wei Wang , Nicu Sebe , Yao Zhao

With the rising popularity of virtual worlds, the importance of data-driven parametric models of 3D meshes has grown rapidly. Numerous applications, such as computer vision, procedural generation, and mesh editing, vastly rely on these…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Robert Kosk , Richard Southern , Lihua You , Shaojun Bian , Willem Kokke , Greg Maguire

The face expression is the first thing we pay attention to when we want to understand a person's state of mind. Thus, the ability to recognize facial expressions in an automatic way is a very interesting research field. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Enrico Randellini , Leonardo Rigutini , Claudio Sacca'

Human facial expressions change dynamically, so their recognition / analysis should be conducted by accounting for the temporal evolution of face deformations either in 2D or 3D. While abundant 2D video data do exist, this is not the case…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 F. Principi , S. Berretti , C. Ferrari , N. Otberdout , M. Daoudi , A. Del Bimbo

This paper proposes an approach to learn generic multi-modal mesh surface representations using a novel scheme for fusing texture and geometric data. Our approach defines an inverse mapping between different geometric descriptors computed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Bilal Taha , Munawar Hayat , Stefano Berretti , Naoufel Werghi

In this paper, we explore how synthetically generated 3D face models can be used to construct a high accuracy ground truth for depth. This allows us to train the Convolutional Neural Networks (CNN) to solve facial depth estimation problems.…

Image and Video Processing · Electrical Eng. & Systems 2020-03-27 Faisal Khan , Shubhajit Basak , Hossein Javidnia , Michael Schukat , Peter Corcoran

The human face constantly conveys information, both consciously and subconsciously. However, as basic as it is for humans to visually interpret this information, it is quite a big challenge for machines. Conventional semantic facial feature…

Machine Learning · Computer Science 2016-10-21 Amogh Gudi

The transfer of facial expressions from people to 3D face models is a classic computer graphics problem. In this paper, we present a novel, learning-based approach to transferring facial expressions and head movements from images and videos…

Graphics · Computer Science 2021-11-15 Xiao S. Zeng , Surya Dwarakanath , Wuyue Lu , Masaki Nakada , Demetri Terzopoulos