English
Related papers

Related papers: Comprehensive Facial Expression Synthesis using Hu…

200 papers

Employing deep learning-based approaches for fine-grained facial expression analysis, such as those involving the estimation of Action Unit (AU) intensities, is difficult due to the lack of a large-scale dataset of real faces with…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Zhilei Liu , Guoxian Song , Jianfei Cai , Tat-Jen Cham , Juyong Zhang

Speech-driven 3D facial animation technology has been developed for years, but its practical application still lacks expectations. The main challenges lie in data limitations, lip alignment, and the naturalness of facial expressions.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Xiangyu Liang , Wenlin Zhuang , Tianyong Wang , Guangxing Geng , Guangyue Geng , Haifeng Xia , Siyu Xia

Facial expressions are an important way through which humans interact socially. Building a system capable of automatically recognizing facial expressions from images and video has been an intense field of study in recent years. Interpreting…

Computer Vision and Pattern Recognition · Computer Science 2016-06-13 Ciprian Corneanu , Marc Oliu , Jeffrey F. Cohn , Sergio Escalera

Facial expression transfer between two unpaired images is a challenging problem, as fine-grained expression is typically tangled with other facial attributes. Most existing methods treat expression transfer as an application of expression…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Zhiwen Shao , Hengliang Zhu , Junshu Tang , Xuequan Lu , Lizhuang Ma

People talk with diversified styles. For one piece of speech, different talking styles exhibit significant differences in the facial and head pose movements. For example, the "excited" style usually talks with the mouth wide open, while the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Haozhe Wu , Jia Jia , Haoyu Wang , Yishun Dou , Chao Duan , Qingshan Deng

State-of-the-art sign language generation frameworks lack expressivity and naturalness which is the result of only focusing manual signs, neglecting the affective, grammatical and semantic functions of facial expressions. The purpose of…

Computation and Language · Computer Science 2024-10-21 Carla Viegas , Mert İnan , Lorna Quandt , Malihe Alikhani

Speech-driven facial animation involves using a speech signal to generate realistic videos of talking faces. Recent deep learning approaches to facial synthesis rely on extracting low-dimensional representations and concatenating them,…

Humans are skilled in reading the interlocutor's emotion from multimodal signals, including spoken words, simultaneous speech, and facial expressions. It is still a challenge to effectively decode emotions from the complex interactions of…

Machine Learning · Computer Science 2022-12-20 Feng Qiu , Chengyang Xie , Yu Ding , Wanzeng Kong

This paper aims at generating a new face based on the human like description using a new concept. The FASY (FAce SYnthesis) System is a Face Database Retrieval and new Face generation System that is under development. One of its main…

Computer Vision and Pattern Recognition · Computer Science 2010-07-01 Santanu Halder , Debotosh Bhattacharjee , Mita Nasipuri , Dipak Kumar Basu , Mahantapas Kundu

Speech-driven 3D facial animation has been widely explored, with applications in gaming, character animation, virtual reality, and telepresence systems. State-of-the-art methods deform the face topology of the target actor to sync the input…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Balamurugan Thambiraja , Ikhsanul Habibie , Sadegh Aliakbarian , Darren Cosker , Christian Theobalt , Justus Thies

The diversity of facial shapes and motions among persons is one of the greatest challenges for automatic analysis of facial expressions. In this paper, we propose a feature describing expression intensity over time, while being invariant to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Maren Awiszus , Stella Graßhof , Felix Kuhnke , Jörn Ostermann

3D facial animation is often produced by manipulating facial deformation models (or rigs), that are traditionally parameterized by expression controls. A key component that is usually overlooked is expression 'style', as in, how a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Lingchen Yang , Gaspard Zoss , Prashanth Chandran , Paulo Gotardo , Markus Gross , Barbara Solenthaler , Eftychios Sifakis , Derek Bradley

The ability to edit facial expressions has a wide range of applications in computer graphics. The ideal facial expression editing algorithm needs to satisfy two important criteria. First, it should allow precise and targeted editing of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Alara Zindancıoğlu , T. Metin Sezgin

We present a novel one-shot talking head synthesis method that achieves disentangled and fine-grained control over lip motion, eye gaze&blink, head pose, and emotional expression. We represent different motions via disentangled latent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Duomin Wang , Yu Deng , Zixin Yin , Heung-Yeung Shum , Baoyuan Wang

Over the past few years, the automatic generation of facial animation for virtual characters has garnered interest among the animation research and industry communities. Recent research contributions leverage machine-learning approaches to…

Graphics · Computer Science 2020-07-21 Eloïse Berson , Catherine Soladié , Vincent Barrielle , Nicolas Stoiber

Human face-to-face conversation is an ideal model for human-computer dialogue. One of the major features of face-to-face communication is its multiplicity of communication channels that act on multiple modalities. To realize a natural…

cmp-lg · Computer Science 2008-02-03 Katashi Nagao , Akikazu Takeuchi

This paper presents a generative adversarial learning-based human upper body video synthesis approach to generate an upper body video of target person that is consistent with the body motion, face expression, and pose of the person in…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Zhaoxiang Liu , Huan Hu , Zipeng Wang , Kai Wang , Jinqiang Bai , Shiguo Lian

Facial expression synthesis or editing has recently received increasing attention in the field of affective computing and facial expression modeling. However, most existing facial expression synthesis works are limited in paired training…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Zhilei Liu , Diyi Liu , Yunpeng Wu

Emotional speech synthesis aims to synthesize human voices with various emotional effects. The current studies are mostly focused on imitating an averaged style belonging to a specific emotion type. In this paper, we seek to generate speech…

Computation and Language · Computer Science 2023-01-02 Kun Zhou , Berrak Sisman , Rajib Rana , B. W. Schuller , Haizhou Li

Expression cloning plays an important role in facial expression synthesis. In this paper, a novel algorithm is proposed for facial expression cloning. The proposed algorithm first introduces a new elastic model to balance the global and…

Graphics · Computer Science 2015-03-03 Yihao Zhang , Weiyao Lin , Bing Zhou , Zhenzhong Chen , Bin Sheng , Jianxin Wu , Wenjun Zhang