English
Related papers

Related papers: A Dual Branch Network for Emotional Reaction Inten…

200 papers

Automatic emotion recognition for real-life appli-cations is a challenging task. Human emotion expressions aresubtle, and can be conveyed by a combination of several emo-tions. In most existing emotion recognition studies, each…

Sound · Computer Science 2022-03-08 Jay Desai , Houwei Cao , Ravi Shah

Most existing emotion analysis emphasizes which emotion arises (e.g., happy, sad, angry) but neglects the deeper why. We propose Emotion Interpretation (EI), focusing on causal factors-whether explicit (e.g., observable objects,…

Artificial Intelligence · Computer Science 2025-04-18 Yuxiang Lin , Jingdong Sun , Zhi-Qi Cheng , Jue Wang , Haomin Liang , Zebang Cheng , Yifei Dong , Jun-Yan He , Xiaojiang Peng , Xian-Sheng Hua

Existing works on multimodal affective computing tasks, such as emotion recognition, generally adopt a two-phase pipeline, first extracting feature representations for each single modality with hand-crafted algorithms and then performing…

Computation and Language · Computer Science 2021-12-06 Wenliang Dai , Samuel Cahyawijaya , Zihan Liu , Pascale Fung

The research and applications of multimodal emotion recognition have become increasingly popular recently. However, multimodal emotion recognition faces the challenge of lack of data. To solve this problem, we propose to use transfer…

Computation and Language · Computer Science 2022-07-13 Zihan Zhao , Yanfeng Wang , Yu Wang

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

Physiological signals that provide the objective repression of human affective states are attracted increasing attention in the emotion recognition field. However, the single signal is difficult to obtain completely and accurately…

Machine Learning · Computer Science 2020-01-03 Jing Zhang , Yong Zhang , Suhua Zhan , Cheng Cheng

Emotion plays a fundamental role in human interaction, and therefore systems capable of identifying emotions in speech are crucial in the context of human-computer interaction. Speech emotion recognition (SER) is a challenging problem,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Lucas Ueda , João Lima , Leonardo Marques , Paula Costa

Continuous affect prediction in the wild is a very interesting problem and is challenging as continuous prediction involves heavy computation. This paper presents the methodologies and techniques used in our contribution to predict…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-02 Sowmya Rasipuram , Junaid Hamid Bhat , Anutosh Maitra

To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals.…

Human-Computer Interaction · Computer Science 2016-02-29 Wei Liu , Wei-Long Zheng , Bao-Liang Lu

Facial Expression Recognition(FER) is one of the most important topic in Human-Computer interactions(HCI). In this work we report details and experimental results about a facial expression recognition method based on state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Donato Cafarelli , Fabio Valerio Massoli , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

Human-Computer Interaction · Computer Science 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

While increasing research focuses on the emotional well-being of agile team members, a significant gap remains in emotion monitoring studies for Scrum Masters and meeting organizers, whose impact on team dynamics is crucial. This paper…

Artificial Intelligence · Computer Science 2026-05-19 Jingni Huang , Peter Bloodsworth

To address the limitation in multimodal emotion recognition (MER) performance arising from inter-modal information fusion, we propose a novel MER framework based on multitask learning where fusion occurs after alignment, called Foal-Net.…

Multimedia · Computer Science 2024-08-20 Qifei Li , Yingming Gao , Yuhua Wen , Cong Wang , Ya Li

In this report, we present our solution for the Action Unit (AU) Detection Challenge, in 8th Competition on Affective Behavior Analysis in-the-wild. In order to achieve robust and accurate classification of facial action unit in the wild…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jun Yu , Yunxiang Zhang , Xilong Lu , Yang Zheng , Yongqi Wang , Lingsi Zhu

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

In this paper, we propose a two-layered multi-task attention based neural network that performs sentiment analysis through emotion analysis. The proposed approach is based on Bidirectional Long Short-Term Memory and uses Distributional…

Computation and Language · Computer Science 2019-12-02 Abhishek Kumar , Asif Ekbal , Daisuke Kawahra , Sadao Kurohashi

Facial expression recognition is an essential task for various applications, including emotion detection, mental health analysis, and human-machine interactions. In this paper, we propose a multi-modal facial expression recognition method…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun-Hwa Kim , Namho Kim , Chee Sun Won

Effective human-agent interaction (HAI) relies on accurate and adaptive perception of human emotional states. While multimodal deep learning models - leveraging facial expressions, speech, and textual cues - offer high accuracy in emotion…

Machine Learning · Computer Science 2025-12-15 Matvey Nepomnyaschiy , Oleg Pereziabov , Anvar Tliamov , Stanislav Mikhailov , Ilya Afanasyev

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Human emotion recognition plays a crucial role in facilitating seamless interactions between humans and computers. In this paper, we present our innovative methodology for tackling the Valence-Arousal (VA) Estimation Challenge, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Weiwei Zhou , Chenkun Ling , Zefeng Cai