English
Related papers

Related papers: Interpretable Explainability in Facial Emotion Rec…

200 papers

Emotions are best way of communicating information; and sometimes it carry more information than words. Recently, there has been a huge interest in automatic recognition of human emotion because of its wide spread application in security,…

Computer Vision and Pattern Recognition · Computer Science 2013-12-05 Nikunj Bajaj , Aurobinda Routray , S L Happy

This paper introduces a novel method for generating artistic images that express particular affective states. Leveraging state-of-the-art deep learning methods for visual generation (through generative adversarial networks), semantic models…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Theodoros Galanos , Antonios Liapis , Georgios N. Yannakakis

Facial micro-expressions are very brief, spontaneous facial expressions that appear on the face of humans when they either deliberately or unconsciously conceal an emotion. Micro-expression has shorter duration than macro-expression, which…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Walied Merghani , Adrian K. Davison , Moi Hoon Yap

Recently audio-driven talking face video generation has attracted considerable attention. However, very few researches address the issue of emotional editing of these talking face videos with continuously controllable expressions, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyao Sun , Yu-Hui Wen , Tian Lv , Yanan Sun , Ziyang Zhang , Yaoyuan Wang , Yong-Jin Liu

Emotion detection in older adults is crucial for understanding their cognitive and emotional well-being, especially in hospital and assisted living environments. In this work, we investigate an edge-based, non-obtrusive approach to emotion…

Human-Computer Interaction · Computer Science 2025-07-14 Md. Saif Hassan Onim , Andrew M. Kiselica , Himanshu Thapliyal

In our multicultural world, affect-aware AI systems that support humans need the ability to perceive affect across variations in emotion expression patterns across cultures. These systems must perform well in cultural contexts without…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Leena Mathur , Ralph Adolphs , Maja J Matarić

Facial expression recognition plays an important role in human behaviour, communication, and interaction. Recent neural networks have demonstrated to perform well at its automatic recognition, with different explainability techniques…

Human-Computer Interaction · Computer Science 2024-05-21 Silvia Ramis Guarinos , Cristina Manresa Yee , Jose Maria Buades Rubio , Francesc Xavier Gaya-Morey

In this paper, we describe our algorithmic approach, which was used for submissions in the fifth Emotion Recognition in the Wild (EmotiW 2017) group-level emotion recognition sub-challenge. We extracted feature vectors of detected faces…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Alexandr G. Rassadin , Alexey S. Gruzdev , Andrey V. Savchenko

Expression recognition holds great promise for applications such as content recommendation and mental healthcare by accurately detecting users' emotional states. Traditional methods often rely on cameras or wearable sensors, which raise…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Guangjing Wang , Juexing Wang , Ce Zhou , Weikang Ding , Huacheng Zeng , Tianxing Li , Qiben Yan

Emotional expressions are inherently multimodal -- integrating facial behavior, speech, and gaze -- but their automatic recognition is often limited to a single modality, e.g. speech during a phone call. While previous work proposed…

Machine Learning · Computer Science 2022-05-03 Ahmed Abdou , Ekta Sood , Philipp Müller , Andreas Bulling

Facial expressions are a form of non-verbal communication that humans perform seamlessly for meaningful transfer of information. Most of the literature addresses the facial expression recognition aspect however, with the advent of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 J. Rafid Siddiqui

Emotions widely affect human decision-making. This fact is taken into account by affective computing with the goal of tailoring decision support to the emotional states of individuals. However, the accurate recognition of emotions within…

Computation and Language · Computer Science 2018-11-14 Bernhard Kratzwald , Suzana Ilic , Mathias Kraus , Stefan Feuerriegel , Helmut Prendinger

Automatic Emotion Detection (ED) aims to build systems to identify users' emotions automatically. This field has the potential to enhance HCI, creating an individualised experience for the user. However, ED systems tend to perform poorly on…

Human-Computer Interaction · Computer Science 2023-07-27 Annanda Sousa , Karen Young , Mathieu D'aquin , Manel Zarrouk , Jennifer Holloway

In human-to-computer interaction, facial animation in synchrony with affective speech can deliver more naturalistic conversational agents. In this paper, we present a two-stage deep learning approach for affective speech driven facial shape…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-13 Rizwan Sadiq , Sasan AsadiAbadi , Engin Erzin

Facial expression analysis is central to understanding human behavior, yet existing coding systems such as the Facial Action Coding System (FACS) are constrained by limited coverage and costly manual annotation. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Minh Tran , Maksim Siniukov , Zhangyu Jin , Mohammad Soleymani

Accurate recognition of human emotions is critical for adaptive human-computer interaction, yet remains challenging in dynamic, conversation-like settings. This work presents a personality-aware multimodal framework that integrates…

Due to the subjective crowdsourcing annotations and the inherent inter-class similarity of facial expressions, the real-world Facial Expression Recognition (FER) datasets usually exhibit ambiguous annotation. To simplify the learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Weijie Wang , Bo Li , Nicu Sebe , Bruno Lepri

Incremental learning is a complex process due to potential catastrophic forgetting of old tasks when learning new ones. This is mainly due to transient features that do not fit from task to task. In this paper, we focus on complex emotion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Thibault Geoffroy , Gauthier Gerspacher , Lionel Prevost

The development of existing facial coding systems, such as the Facial Action Coding System (FACS), relied on manual examination of facial expression videos for defining Action Units (AUs). To overcome the labor-intensive nature of this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Shivansh Chandra Tripathi , Rahul Garg

Lie detection is considered a concern for everyone in their day to day life given its impact on human interactions. Thus, people normally pay attention to both what their interlocutors are saying and also to their visual appearances,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Nuria Rodriguez-Diaz , Decky Aspandi , Federico Sukno , Xavier Binefa