English
Related papers

Related papers: The Ambiguous World of Emotion Representation

200 papers

We present an approach utilizing Topological Data Analysis to study the structure of face poses used in affective computing, i.e., the process of recognizing human emotion. The approach uses a conditional comparison of different emotions,…

Human-Computer Interaction · Computer Science 2021-08-04 Hamza Elhamdadi , Shaun Canavan , Paul Rosen

Multimodal learning pipelines have benefited from the success of pretrained language models. However, this comes at the cost of increased model parameters. In this work, we propose Adapted Multimodal BERT (AMB), a BERT-based architecture…

Computation and Language · Computer Science 2022-12-02 Odysseas S. Chlapanis , Georgios Paraskevopoulos , Alexandros Potamianos

Automatically recognizing emotional intent using facial expression has been a thoroughly investigated topic in the realm of computer vision. Facial Expression Recognition (FER), being a supervised learning task, relies heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Syed Sameen Ahmad Rizvi , Aryan Seth , Pratik Narang

Embodied AI has made significant progress acting in unexplored environments. However, tasks such as object search have largely focused on efficient policy learning. In this work, we identify several gaps in current search methods: They…

Facial Expression Recognition (FER) is a classification task that points to face variants. Hence, there are certain affinity features between facial expressions, receiving little attention in the FER literature. Convolution padding, despite…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Jiawei Shi , Songhao Zhu , Zhiwei Liang

Facial Expression Recognition (FER) plays a foundational role in enabling AI systems to interpret emotional nuances, a critical aspect of affective Theory of Mind (ToM). However, existing models often struggle with poor calibration and a…

Human-Computer Interaction · Computer Science 2025-03-24 JiHyun Kim , JuneHyoung Kwon , MiHyeon Kim , Eunju Lee , YoungBin Kim

Affective Image Manipulation (AIM) seeks to modify user-provided images to evoke specific emotional responses. This task is inherently complex due to its twofold objective: significantly evoking the intended emotion, while preserving the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Jingyuan Yang , Jiawei Feng , Weibin Luo , Dani Lischinski , Daniel Cohen-Or , Hui Huang

This research aims at identifying the unknown emotion using speaker cues. In this study, we identify the unknown emotion using a two-stage framework. The first stage focuses on identifying the speaker who uttered the unknown emotion, while…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-11 Ismail Shahin

As technologies become more and more pervasive, there is a need for considering the affective dimension of interaction with computer systems to make them more human-like. Current demands for this matter include accurate emotion recognition,…

Human-Computer Interaction · Computer Science 2018-06-13 Barbara Giżycka , Grzegorz J. Nalepa , Paweł Jemioło

Despite significant progress over the past few years, ambiguity is still a key challenge in Facial Expression Recognition (FER). It can lead to noisy and inconsistent annotation, which hinders the performance of deep learning models in…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Nhat Le , Khanh Nguyen , Quang Tran , Erman Tjiputra , Bac Le , Anh Nguyen

Dynamic facial expression recognition in the wild remains challenging due to data scarcity and long-tail distributions, which hinder models from effectively learning the temporal dynamics of scarce emotions. To address these limitations, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Huanzhen Wang , Ziheng Zhou , Jiaqi Song , Li He , Yunshi Lan , Yan Wang , Wenqiang Zhang

Empathetic Response Generation (ERG) is one of the key tasks of the affective computing area, which aims to produce emotionally nuanced and compassionate responses to user's queries. However, existing ERG research is predominantly confined…

Multimedia · Computer Science 2025-02-10 Han Zhang , Zixiang Meng , Meng Luo , Hong Han , Lizi Liao , Erik Cambria , Hao Fei

Understanding the mental state of other people is an important skill for intelligent agents and robots to operate within social environments. However, the mental processes involved in `mind-reading' are complex. One explanation of such…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jonathan Vitale , Mary-Anne Williams , Benjamin Johnston , Giuseppe Boccignone

People's conduct and reactions are driven by their emotions. Online social media is becoming a great instrument for expressing emotions in written form. Paying attention to the context and the entire sentence help us to detect emotion from…

Computation and Language · Computer Science 2022-09-29 Fereshteh Khoshnam , Ahmad Baraani-Dastjerdi , M. J. Liaghatdar

Speech emotion recognition (SER), particularly for naturally expressed emotions, remains a challenging computational task. Key challenges include the inherent subjectivity in emotion annotation and the imbalanced distribution of emotion…

Sound · Computer Science 2025-06-03 Tiantian Feng , Thanathai Lertpetchpun , Dani Byrd , Shrikanth Narayanan

Speech emotion recognition (SER), the task of identifying the expression of emotion from spoken content, is challenging due to the difficulty in extracting representations that capture emotional attributes from speech. The scarcity of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-27 Soumya Dutta , Sriram Ganapathy

Multimodal multi-label emotion recognition (MMER) aims to identify the concurrent presence of multiple emotions in multimodal data. Existing studies primarily focus on improving fusion strategies and modeling modality-to-label dependencies.…

Computation and Language · Computer Science 2025-02-20 Jingwang Huang , Jiang Zhong , Qin Lei , Jinpeng Gao , Yuming Yang , Sirui Wang , Peiguang Li , Kaiwen Wei

Millions of images on the web enable us to explore images from social events such as a family party, thus it is of interest to understand and model the affect exhibited by a group of people in images. But analysis of the affect expressed by…

Computer Vision and Pattern Recognition · Computer Science 2016-10-17 Xiaohua Huang , Abhinav Dhall , Xin Liu , Guoying Zhao , Jingang Shi , Roland Goecke , Matti Pietikainen

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen

Recent advances in neurosciences and psychology have provided evidence that affective phenomena pervade intelligence at many levels, being inseparable from the cognitionaction loop. Perception, attention, memory, learning, decisionmaking,…

Artificial Intelligence · Computer Science 2008-09-30 Luis Paulo Reis , Daria Barteneva , Nuno Lau