English
Related papers

Related papers: Is Micro-expression Ethnic Leaning?

200 papers

Emotion plays an important role in human cognition and performance. Motivated by this, we investigate whether analogous emotional signals can shape the behavior of large language models (LLMs) and agents. Existing emotion-aware studies…

Artificial Intelligence · Computer Science 2026-04-02 Moran Sun , Tianlin Li , Yuwei Zheng , Zhenhong Zhou , Aishan Liu , Xianglong Liu , Yang Liu

In recent decades, the field of affective computing has made substantial progress in advancing the ability of AI systems to recognize and express affective phenomena, such as affect and emotions, during human-human and human-machine…

Human-Computer Interaction · Computer Science 2023-05-19 Leena Mathur , Maja J Matarić , Louis-Philippe Morency

Music Emotion Recognition involves the automatic identification of emotional elements within music tracks, and it has garnered significant attention due to its broad applicability in the field of Music Information Retrieval. It can also be…

Sound · Computer Science 2023-08-29 Kexin Zhu , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Multimodal emotion recognition (MER) aims to identify human emotions by combining data from various modalities such as language, audio, and vision. Despite the recent advances of MER approaches, the limitations in obtaining extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yehun Song , Sunyoung Cho

Analysing expressions on the person's face plays a very vital role in identifying emotions and behavior of a person. Recognizing these expressions automatically results in a crucial component of natural human-machine interfaces. Therefore…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Abhinav Lahariya , Varsha Singh , Uma Shanker Tiwary

We propose emotion2vec, a universal speech emotion representation model. emotion2vec is pre-trained on open-source unlabeled emotion data through self-supervised online distillation, combining utterance-level loss and frame-level loss…

Computation and Language · Computer Science 2023-12-27 Ziyang Ma , Zhisheng Zheng , Jiaxin Ye , Jinchao Li , Zhifu Gao , Shiliang Zhang , Xie Chen

Facial Expression Recognition (FER) uses images of faces to identify the emotional state of users, allowing for a closer interaction between humans and autonomous systems. Unfortunately, as the images naturally integrate some demographic…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar

As a spontaneous expression of emotion on face, micro-expression reveals the underlying emotion that cannot be controlled by human. In micro-expression, facial movement is transient and sparsely localized through time. However, the existing…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Min Peng , Chongyang Wang , Yuan Gao , Tao Bi , Tong Chen , Yu Shi , Xiang-Dong Zhou

In the last decades, global awareness towards the importance of diverse representation has been increasing. Lack of diversity and discrimination toward minorities did not skip the film industry. Here, we examine ethnic bias in the film…

Computers and Society · Computer Science 2022-07-19 Dima Kagan , Mor Levy , Michael Fire , Galit Fuhrmann Alpert

Emerging psychopathology studies are showing that patterns of changes in emotional state -- emotion dynamics -- are associated with overall well-being and mental health. More recently, there has been some work in tracking emotion dynamics…

Computation and Language · Computer Science 2023-06-09 Daniela Teodorescu , Alona Fyshe , Saif M. Mohammad

Emotion expression is central to human--robot interaction, yet little is known about how people interpret affect on robots with sparse, non-anthropomorphic expressive capabilities. This study examined how people perceive emotional…

Robotics · Computer Science 2026-05-14 Amit Rogel , Elmira Yadollahi , Guy Laban

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

Current computational-emotion research has focused on applying acoustic properties to analyze how emotions are perceived mathematically or used in natural language processing machine learning models. While recent interest has focused on…

Sound · Computer Science 2021-07-06 Daniel Szelogowski

Electroencephalography (EEG) is an objective tool for emotion recognition and shows promising performance. However, the label scarcity problem is a main challenge in this field, which limits the wide application of EEG-based emotion…

Signal Processing · Electrical Eng. & Systems 2024-09-02 Rushuang Zhou , Weishan Ye , Zhiguo Zhang , Yanyang Luo , Li Zhang , Linling Li , Gan Huang , Yining Dong , Yuan-Ting Zhang , Zhen Liang

Although pervasive sensing technologies are increasingly capable of continuously detecting human emotional states, there is still a critical challenge: how to unobtrusively communicate this sensed data back to the user. Realistic avatars…

Human-Computer Interaction · Computer Science 2026-05-13 Michal R. Wrobel , Duygun Erol Barkana , Agnieszka Landowska

In recent years, more and more researchers have reflected on the undervaluation of emotion in data visualization and highlighted the importance of considering human emotion in visualization design. Meanwhile, an increasing number of studies…

Human-Computer Interaction · Computer Science 2024-11-13 Xingyu Lan , Yanqiu Wu , Nan Cao

Emotional talking-head generation has emerged as a pivotal research area at the intersection of computer vision and multimodal artificial intelligence, with its core value lying in enhancing human-computer interaction through immersive and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Hanlei Shi , Leyuan Qu , Yu Liu , Di Gao , Yuhua Zheng , Taihao Li

While machine learning approaches to visual emotion recognition offer great promise, current methods consider training and testing models on small scale datasets covering limited visual emotion concepts. Our analysis identifies an important…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Rameswar Panda , Jianming Zhang , Haoxiang Li , Joon-Young Lee , Xin Lu , Amit K. Roy-Chowdhury

Emotional expressions are the behaviors that communicate our emotional state or attitude to others. They are expressed through verbal and non-verbal communication. Complex human behavior can be understood by studying physical features from…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Liam Schoneveld , Alice Othmani , Hazem Abdelkawy

The portrayal of negative emotions such as anger can vary widely between cultures and contexts, depending on the acceptability of expressing full-blown emotions rather than suppression to maintain harmony. The majority of emotional datasets…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Roya Javadi , Angelica Lim