English
Related papers

Related papers: Revisiting Emotions Representation for Recognition…

200 papers

In recent years, great strides have been made in the field of affective computing. Several models have been developed to represent and quantify emotions. Two popular ones include (i) categorical models which represent emotions as discrete…

Artificial Intelligence · Computer Science 2020-12-01 Surabhi S. Nath , Vishaal Udandarao , Jainendra Shukla

In this paper, we consider the problem of real-time video-based facial emotion analytics, namely, facial expression recognition, prediction of valence and arousal and detection of action unit points. We propose the novel frame-level emotion…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Andrey V. Savchenko

Although the terms mood and emotion are closely related and often used interchangeably, they are distinguished based on their duration, intensity and attribution. To date, hardly any computational models have (a) examined mood recognition,…

Human-Computer Interaction · Computer Science 2022-10-04 Soujanya Narayana , Ramanathan Subramanian , Ibrahim Radwan , Roland Goecke

Automatic understanding of human affect using visual signals is of great importance in everyday human-machine interactions. Appraising human emotional states, behaviors and reactions displayed in real-world settings, can be accomplished…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Dimitrios Kollias , Panagiotis Tzirakis , Mihalis A. Nicolaou , Athanasios Papaioannou , Guoying Zhao , Björn Schuller , Irene Kotsia , Stefanos Zafeiriou

Among human affective behavior research, facial expression recognition research is improving in performance along with the development of deep learning. However, for improved performance, not only past images but also future images should…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Geesung Oh , Euiseok Jeong , Sejoon Lim

In the science of emotion, it is widely assumed that folk emotion categories form a biological and psychological typology, and studies are routinely designed and analyzed to identify emotion-specific patterns. This approach shapes the…

Machine Learning · Computer Science 2025-07-02 Christiana Westlin , Ashutosh Singh , Deniz Erdogmus , Georgios Stratis , Lisa Feldman Barrett

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

For computers to recognize human emotions, expression classification is an equally important problem in the human-computer interaction area. In the 3rd Affective Behavior Analysis In-The-Wild competition, the task of expression…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Kim Ngan Phan , Hong-Hai Nguyen , Van-Thong Huynh , Soo-Hyung Kim

Due to the subjective crowdsourcing annotations and the inherent inter-class similarity of facial expressions, the real-world Facial Expression Recognition (FER) datasets usually exhibit ambiguous annotation. To simplify the learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Weijie Wang , Bo Li , Nicu Sebe , Bruno Lepri

Emotion recognition algorithms rely on data annotated with high quality labels. However, emotion expression and perception are inherently subjective. There is generally not a single annotation that can be unambiguously declared "correct".…

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (e.g., facial expression, speech) or implicitly (e.g., text, image). Enabling machines to have emotional…

Signal Processing · Electrical Eng. & Systems 2021-11-10 Sicheng Zhao , Guoli Jia , Jufeng Yang , Guiguang Ding , Kurt Keutzer

Understanding emotions in natural language is inherently a multi-dimensional reasoning problem, where multiple affective signals interact through context, interpersonal relations, and situational cues. However, most existing emotion…

Computation and Language · Computer Science 2026-04-02 Hemanth Kotaprolu , Kishan Maharaj , Raey Zhao , Abhijit Mishra , Pushpak Bhattacharyya

Mapping discrete and dimensional models of emotion remains a persistent challenge in affective science and computing. This incompatibility hinders the combination of valuable data sets, creating a significant bottleneck for training robust…

Human-Computer Interaction · Computer Science 2025-11-18 Michal R. Wrobel

Museums are important sites for the dissemination of culture and art. They are institutions rooted in history and tradition; their exhibitions are often designed to highlight these aspects. Recently, a new approach is being explored in the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Émile Bergeron , Tadagbé Dhossou , Sébastien Tremblay , Jean-François Lalonde

Affective Behavior Analysis aims to facilitate technology emotionally smart, creating a world where devices can understand and react to our emotions as humans do. To comprehensively evaluate the authenticity and applicability of emotional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Wei Zhang , Feng Qiu , Chen Liu , Lincheng Li , Heming Du , Tiancheng Guo , Xin Yu

Emotion recognition has become an important field of research in the human-computer interactions domain. The latest advancements in the field show that combining visual with audio information lead to better results if compared to the case…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Nicolae-Catalin Ristea , Liviu Cristian Dutu , Anamaria Radoi

Visual Emotion Analysis (VEA) aims at predicting people's emotional responses to visual stimuli. This is a promising, yet challenging, task in affective computing, which has drawn increasing attention in recent years. Most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Jingyuan Yang , Qirui Huang , Tingting Ding , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Multimodal emotion recognition study is hindered by the lack of labelled corpora in terms of scale and diversity, due to the high annotation cost and label ambiguity. In this paper, we propose a pre-training model \textbf{MEmoBERT} for…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jinming Zhao , Ruichen Li , Qin Jin , Xinchao Wang , Haizhou Li

Emotion recognition in social situations is a complex task that requires integrating information from both facial expressions and the situational context. While traditional approaches to automatic emotion recognition have focused on…

Human-Computer Interaction · Computer Science 2024-08-05 Bin Han , Cleo Yau , Su Lei , Jonathan Gratch

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski