English
Related papers

Related papers: A Systematic Review on Affective Computing: Emotio…

200 papers

Multimodal affective computing, learning to recognize and interpret human affects and subjective information from multiple data sources, is still challenging because: (i) it is hard to extract informative features to represent human affects…

Computation and Language · Computer Science 2018-05-23 Yue Gu , Kangning Yang , Shiyu Fu , Shuhong Chen , Xinyu Li , Ivan Marsic

Multi-modal affective computing aims to automatically recognize and interpret human attitudes from diverse data sources such as images and text, thereby enhancing human-computer interaction and emotion understanding. Existing approaches…

Computation and Language · Computer Science 2025-06-10 Yuanhe Tian , Pengsen Cheng , Guoqing Jin , Lei Zhang , Yan Song

Human emotion is expressed in many communication modalities and media formats and so their computational study is equally diversified into natural language processing, audio signal analysis, computer vision, etc. Similarly, the large…

Machine Learning · Computer Science 2023-08-16 Sven Buechel , Udo Hahn

Emotion recognition has become an important field of research in the human-computer interactions domain. The latest advancements in the field show that combining visual with audio information lead to better results if compared to the case…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Nicolae-Catalin Ristea , Liviu Cristian Dutu , Anamaria Radoi

Affective reactions have deep biological foundations, however in humans the development of emotion concepts is also shaped by language and higher-order cognition. A recent breakthrough in AI has been the creation of multimodal language…

Human-Computer Interaction · Computer Science 2025-07-29 Zaira Romeo , Alberto Testolin

Emotions play a central role in human communication, shaping trust, engagement, and social interaction. As artificial intelligence systems powered by large language models become increasingly integrated into everyday life, enabling them to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Soumya Dutta

Emotion recognition is a fundamental component of next-generation human-computer interaction (HCI), enabling machines to perceive, understand, and respond to users' affective states. However, existing systems often rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Ziwen Zhong , Zhitao Shu , Yue Zhao

This paper examines the integration of emotional intelligence into artificial intelligence systems, with a focus on affective computing and the growing capabilities of Large Language Models (LLMs), such as ChatGPT and Claude, to recognize…

Computers and Society · Computer Science 2025-09-26 Nicola Fabiano

Emotion is an experience associated with a particular pattern of physiological activity along with different physiological, behavioral and cognitive changes. One behavioral change is facial expression, which has been studied extensively…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xiaotian Li , Xiang Zhang , Huiyuan Yang , Wenna Duan , Weiying Dai , Lijun Yin

Agents must monitor their partners' affective states continuously in order to understand and engage in social interactions. However, methods for evaluating affect recognition do not account for changes in classification performance that may…

Human-Computer Interaction · Computer Science 2025-09-08 Allen Chang , Lauren Klein , Marcelo R. Rosales , Weiyang Deng , Beth A. Smith , Maja J. Matarić

Current computational-emotion research has focused on applying acoustic properties to analyze how emotions are perceived mathematically or used in natural language processing machine learning models. While recent interest has focused on…

Sound · Computer Science 2021-07-06 Daniel Szelogowski

Multimodal affective computing analyzes user-generated social media content to predict emotional states. However, a critical gap remains in understanding how visual content shapes cognitive interpretations and elicits specific affective…

Artificial Intelligence · Computer Science 2026-04-28 Nastaran Dab , Raziyeh Zall , Mohammadreza Kangavari

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

Human-Computer Interaction · Computer Science 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

As one of the most important affective signals, facial affect analysis (FAA) is essential for developing human-computer interaction systems. Early methods focus on extracting appearance and geometry features associated with human affects…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Yang Liu , Xingming Zhang , Yante Li , Jinzhao Zhou , Xin Li , Guoying Zhao

Multimodal emotion analysis performed better in emotion recognition depending on more comprehensive emotional clues and multimodal emotion dataset. In this paper, we developed a large multimodal emotion dataset, named "HED" dataset, to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhongyu Fang , Aoyun He , Qihui Yu , Baopeng Gao , Weiping Ding , Tong Zhang , Lei Ma

In our multicultural world, affect-aware AI systems that support humans need the ability to perceive affect across variations in emotion expression patterns across cultures. These systems must perform well in cultural contexts without…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Leena Mathur , Ralph Adolphs , Maja J Matarić

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (e.g., facial expression, speech) or implicitly (e.g., text, image). Enabling machines to have emotional…

Signal Processing · Electrical Eng. & Systems 2021-11-10 Sicheng Zhao , Guoli Jia , Jufeng Yang , Guiguang Ding , Kurt Keutzer

In the field of affective computing, where research continually advances at a rapid pace, the demand for user-friendly tools has become increasingly apparent. In this paper, we present the AffectToolbox, a novel software system that aims to…

Human-Computer Interaction · Computer Science 2024-02-26 Silvan Mertes , Dominik Schiller , Michael Dietz , Elisabeth André , Florian Lingenfelser

Affective computing has made significant strides in emotion recognition and generation, yet current approaches mainly focus on short-term pattern recognition and lack a comprehensive framework to guide affective agents toward long-term…

Human-Computer Interaction · Computer Science 2025-02-26 Bin Yin , Chong-Yi Liu , Liya Fu , Jinkun Zhang

The project leverages advanced machine and deep learning techniques to address the challenge of emotion recognition by focusing on non-facial cues, specifically hands, body gestures, and gestures. Traditional emotion recognition systems…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Haoyang Liu