English
Related papers

Related papers: Emotion Dependent Facial Animation from Affective …

200 papers

Deep convolutional neural networks have been shown to successfully recognize facial emotions for the past years in the realm of computer vision. However, the existing detection approaches are not always reliable or explainable, we here…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Jiawen Wang , Leah Kawka

Emotion recognition has become an important field of research in the human-computer interactions domain. The latest advancements in the field show that combining visual with audio information lead to better results if compared to the case…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Nicolae-Catalin Ristea , Liviu Cristian Dutu , Anamaria Radoi

Speech-driven 3D facial animation seeks to produce lifelike facial expressions that are synchronized with the speech content and its emotional nuances, finding applications in various multimedia fields. However, previous methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yixuan Zhang , Qing Chang , Yuxi Wang , Guang Chen , Zhaoxiang Zhang , Junran Peng

In this paper we address the problem of multi-cue affect recognition in challenging scenarios such as child-robot interaction. Towards this goal we propose a method for automatic recognition of affect that leverages body expressions…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Panagiotis P. Filntisis , Niki Efthymiou , Petros Koutras , Gerasimos Potamianos , Petros Maragos

The creation of increasingly vivid 3D talking face has become a hot topic in recent years. Currently, most speech-driven works focus on lip synchronisation but neglect to effectively capture the correlations between emotions and facial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yihong Lin , Liang Peng , Zhaoxin Fan , Xianjia Wu , Jianqiao Hu , Xiandong Li , Wenxiong Kang , Songju Lei

How much can we infer about an emotional voice solely from an expressive face? This intriguing question holds great potential for applications such as virtual character dubbing and aiding individuals with expressive language disorders.…

Sound · Computer Science 2025-02-04 Jiaxin Ye , Boyuan Cao , Hongming Shan

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi

Speech-driven 3D facial animation has garnered lots of attention thanks to its broad range of applications. Despite recent advancements in achieving realistic lip motion, current methods fail to capture the nuanced emotional undertones…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jisoo Kim , Jungbin Cho , Joonho Park , Soonmin Hwang , Da Eun Kim , Geon Kim , Youngjae Yu

Emotion has an important role in daily life, as it helps people better communicate with and understand each other more efficiently. Facial expressions can be classified into 7 categories: angry, disgust, fear, happy, neutral, sad and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Shaoyuan Xu , Yang Cheng , Qian Lin , Jan P. Allebach

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

Machine Learning · Computer Science 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Visual emotion expression plays an important role in audiovisual speech communication. In this work, we propose a novel approach to rendering visual emotion expression in speech-driven talking face generation. Specifically, we design an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-23 Sefik Emre Eskimez , You Zhang , Zhiyao Duan

In this paper, a deep learning framework is proposed for automatic facial emotion based on deep convolutional networks. In order to increase the generalization ability and the robustness of the method, the dataset size is increased by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Serap Kırbız

Emotion being a subjective thing, leveraging knowledge and science behind labeled data and extracting the components that constitute it, has been a challenging problem in the industry for many years. With the evolution of deep learning in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Prudhvi Raj Dachapally

Speech-driven facial animation is the process which uses speech signals to automatically synthesize a talking character. The majority of work in this domain creates a mapping from audio features to visual features. This often requires…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-20 Konstantinos Vougioukas , Stavros Petridis , Maja Pantic

Audio-driven 3D facial animation has several virtual humans applications for content creation and editing. While several existing methods provide solutions for speech-driven animation, precise control over content (what) and style (how) of…

Sound · Computer Science 2024-08-15 Qingju Liu , Hyeongwoo Kim , Gaurav Bharaj

The use of deep learning techniques for automatic facial expression recognition has recently attracted great interest but developed models are still unable to generalize well due to the lack of large emotion datasets for deep learning. To…

Computer Vision and Pattern Recognition · Computer Science 2018-05-28 Dung Nguyen , Kien Nguyen , Sridha Sridharan , Iman Abbasnejad , David Dean , Clinton Fookes

3D facial animation is often produced by manipulating facial deformation models (or rigs), that are traditionally parameterized by expression controls. A key component that is usually overlooked is expression 'style', as in, how a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Lingchen Yang , Gaspard Zoss , Prashanth Chandran , Paulo Gotardo , Markus Gross , Barbara Solenthaler , Eftychios Sifakis , Derek Bradley

Recently, emotional talking face generation has received considerable attention. However, existing methods only adopt one-hot coding, image, or audio as emotion conditions, thus lacking flexible control in practical applications and failing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Chao Xu , Junwei Zhu , Jiangning Zhang , Yue Han , Wenqing Chu , Ying Tai , Chengjie Wang , Zhifeng Xie , Yong Liu

This work proposes to explore a new area of dynamic speech emotion recognition. Unlike traditional methods, we assume that each audio track is associated with a sequence of emotions active at different moments in time. The study…

Sound · Computer Science 2025-08-22 Ilya Fedorov , Dmitry Korobchenko

Facial expression perception in humans inherently relies on prior knowledge and contextual cues, contributing to efficient and flexible processing. For instance, multi-modal emotional context (such as voice color, affective text, body pose,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Florian Blume , Runfeng Qu , Pia Bideau , Martin Maier , Rasha Abdel Rahman , Olaf Hellwich