English
Related papers

Related papers: Interpretable Explainability in Facial Emotion Rec…

200 papers

Human emotion is expressed in many communication modalities and media formats and so their computational study is equally diversified into natural language processing, audio signal analysis, computer vision, etc. Similarly, the large…

Machine Learning · Computer Science 2023-08-16 Sven Buechel , Udo Hahn

Deep convolutional neural networks have been shown to successfully recognize facial emotions for the past years in the realm of computer vision. However, the existing detection approaches are not always reliable or explainable, we here…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Jiawen Wang , Leah Kawka

Although psychological research indicates that bodily expressions convey important affective information, to date research in emotion recognition focused mainly on facial expression or voice analysis. In this paper we propose an approach to…

Human-Computer Interaction · Computer Science 2014-02-21 Stefano Piana , Alessandra Staglianò , Francesca Odone , Alessandro Verri , Antonio Camurri

Accurate recognition of human emotions is a crucial challenge in affective computing and human-robot interaction (HRI). Emotional states play a vital role in shaping behaviors, decisions, and social interactions. However, emotional…

Robotics · Computer Science 2024-09-19 Youssef Mohamed , Severin Lemaignan , Arzu Guneysu , Patric Jensfelt , Christian Smith

Humans have a selective memory, remembering relevant episodes and forgetting the less relevant information. Possessing awareness of event memorability for a user could help intelligent systems in more accurate user modelling, especially for…

Human-Computer Interaction · Computer Science 2025-07-21 Maria Tsfasman , Ramin Ghorbani , Catholijn M. Jonker , Bernd Dudzik

Facial expressions are important parts of both gesture and sign language recognition systems. Despite the recent advances in both fields, annotated facial expression datasets in the context of sign language are still scarce resources. In…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Marie Alaghband , Niloofar Yousefi , Ivan Garibay

One of the key research areas in computer vision addressed by a vast number of publications is the processing and understanding of images containing human faces. The most often addressed tasks include face detection, facial landmark…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Chirag Kyal

Despite the significant progress in recent years, very few of the AI-based talking face generation methods attempt to render natural emotions. Moreover, the scope of the methods is majorly limited to the characteristics of the training…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Sanjana Sinha , Sandika Biswas , Ravindra Yadav , Brojeshwar Bhowmick

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (e.g., facial expression, speech) or implicitly (e.g., text, image). Enabling machines to have emotional…

Signal Processing · Electrical Eng. & Systems 2021-11-10 Sicheng Zhao , Guoli Jia , Jufeng Yang , Guiguang Ding , Kurt Keutzer

Understanding the mental state of other people is an important skill for intelligent agents and robots to operate within social environments. However, the mental processes involved in `mind-reading' are complex. One explanation of such…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jonathan Vitale , Mary-Anne Williams , Benjamin Johnston , Giuseppe Boccignone

We propose two face representations that are blind to facial expressions associated to emotional responses. This work is in part motivated by new international regulations for personal data protection, which enforce data controllers to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Alejandro Peña , Julian Fierrez , Agata Lapedriza , Aythami Morales

Children with autism spectrum disorder (ASD) experience challenges in grasping social-emotional cues, which can result in difficulties in recognizing emotions and understanding and responding to social interactions. Social-emotional…

Human-Computer Interaction · Computer Science 2024-04-25 Yue Lyu , Pengcheng An , Huan Zhang , Keiko Katsuragawa , Jian Zhao

This paper proposes a feature-based domain adaptation technique for identifying emotions in generic images, encompassing both facial and non-facial objects, as well as non-human components. This approach addresses the challenge of the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Puneet Kumar , Balasubramanian Raman

Automated Facial Expression Recognition (FER) is challenging due to intra-class variations and inter-class similarities. FER can be especially difficult when facial expressions reflect a mixture of various emotions (aka compound…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Ali Pourramezan Fard , Mohammad Mehdi Hosseini , Timothy D. Sweeny , Mohammad H. Mahoor

Current facial emotion recognition systems are predominately trained to predict a fixed set of predefined categories or abstract dimensional values. This constrained form of supervision hinders generalization and applicability, as it…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Licai Sun , Xingxun Jiang , Haoyu Chen , Yante Li , Zheng Lian , Biu Liu , Yuan Zong , Wenming Zheng , Jukka M. Leppänen , Guoying Zhao

Deepfake detection research has largely converged on deep learning approaches that, despite strong benchmark performance, offer limited insight into what distinguishes real from manipulated facial behavior. This study presents an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Timothy Joseph Murphy , Jennifer Cook , Hélio Clemente José Cuve

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

Cognitive training has shown promising results for delivering improvements in human cognition related to attention, problem solving, reading comprehension and information retrieval. However, two frequently cited problems in cognitive…

Human-Computer Interaction · Computer Science 2020-09-01 Lorcan Reidy , Dennis Chan , Charles Nduka , Hatice Gunes

Complex emotion recognition is a cognitive task that has so far eluded the same excellent performance of other tasks that are at or above the level of human cognition. Emotion recognition through facial expressions is particularly difficult…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Angus Maiden , Bahareh Nakisa

Affective computing and cognitive theory are widely used in modern human-computer interaction scenarios. Human faces, as the most prominent and easily accessible features, have attracted great attention from researchers. Since humans have…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Wenxuan Wang , Yanwei Fu , Qiang Sun , Tao Chen , Chenjie Cao , Ziqi Zheng , Guoqiang Xu , Han Qiu , Yu-Gang Jiang , Xiangyang Xue