English
Related papers

Related papers: MUSER: MUltimodal Stress Detection using Emotion R…

200 papers

Affective states have a critical role in driving performance and safety. They can degrade driver situation awareness and negatively impact cognitive processes, severely diminishing road safety. Therefore, detecting and assessing drivers'…

Machine Learning · Computer Science 2019-07-24 Daniel Lopez-Martinez , Neska El-Haouij , Rosalind Picard

Classification of human emotions can play an essential role in the design and improvement of human-machine systems. While individual biological signals such as Electrocardiogram (ECG) and Electrodermal Activity (EDA) have been widely used…

Machine Learning · Computer Science 2021-08-06 Anubhav Bhatti , Behnam Behinaein , Dirk Rodenburg , Paul Hungler , Ali Etemad

Detecting psychological stress from speech is critical in high-pressure settings. While prior work has leveraged acoustic features for stress detection, most treat stress as a static label. In this work, we model stress as a temporally…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Vishakha Lall , Yisi Liu

Multi-modal conversation emotion recognition (MCER) aims to recognize and track the speaker's emotional state using text, speech, and visual information in the conversation scene. Analyzing and studying MCER issues is significant to…

Artificial Intelligence · Computer Science 2025-11-14 Yuntao Shou , Tao Meng , Wei Ai , Fangze Fu , Nan Yin , Keqin Li

Emotion Recognition (ER) is the process of identifying human emotions from given data. Currently, the field heavily relies on facial expression recognition (FER) because facial expressions contain rich emotional cues. However, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuanyuan Liu , Lin Wei , Kejun Liu , Yibing Zhan , Zijing Chen , Zhe Chen , Shiguang Shan

Emotion recognition is a complex task due to the inherent subjectivity in both the perception and production of emotions. The subjectivity of emotions poses significant challenges in developing accurate and robust computational models. This…

Machine Learning · Computer Science 2023-09-08 Mimansa Jaiswal

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen

This paper discusses a fuzzy model for multi-level human emotions recognition by computer systems through keyboard keystrokes, mouse and touchscreen interactions. This model can also be used to detect the other possible emotions at the time…

Artificial Intelligence · Computer Science 2014-08-05 Kaveh Bakhtiyari , Hafizah Husain

Detecting what emotions are expressed in text is a well-studied problem in natural language processing. However, research on finer grained emotion analysis such as what causes an emotion is still in its infancy. We present solutions that…

Computation and Language · Computer Science 2021-06-21 Elsbeth Turcan , Shuai Wang , Rishita Anubhai , Kasturi Bhattacharjee , Yaser Al-Onaizan , Smaranda Muresan

Recent works have demonstrated the effectiveness of machine learning (ML) techniques in detecting anxiety and stress using physiological signals, but it is unclear whether ML models are learning physiological features specific to stress. To…

Multimedia · Computer Science 2024-02-27 Emily Zhou , Mohammad Soleymani , Maja J. Matarić

Various psychological factors affect how individuals express emotions. Yet, when we collect data intended for use in building emotion recognition systems, we often try to do so by creating paradigms that are designed just with a focus on…

Machine Learning · Computer Science 2019-08-27 Mimansa Jaiswal , Zakaria Aldeneh , Emily Mower Provost

Emotions play a crucial role in human behavior and decision-making, making emotion recognition a key area of interest in human-computer interaction (HCI). This study addresses the challenges of emotion recognition by integrating facial…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Zaitian Wang , Jian He , Yu Liang , Xiyuan Hu , Tianhao Peng , Kaixin Wang , Jiakai Wang , Chenlong Zhang , Weili Zhang , Shuang Niu , Xiaoyang Xie

Multimodal emotion recognition (MER) is crucial for human-computer interaction, yet real-world challenges like dynamic modality incompleteness and asynchrony severely limit its robustness. Existing methods often assume consistently complete…

Human-Computer Interaction · Computer Science 2025-08-19 Yitong Zhu , Lei Han , Guanxuan Jiang , PengYuan Zhou , Yuyang Wang

Limited by the computational capabilities and battery energy of terminal devices and network bandwidth, emotion recognition tasks fail to achieve good interactive experience for users. The intolerable latency for users also seriously…

Networking and Internet Architecture · Computer Science 2019-06-06 Long Hu , Wei Li , Jun Yang , Giancarlo Fortino , Min Chen

The project leverages advanced machine and deep learning techniques to address the challenge of emotion recognition by focusing on non-facial cues, specifically hands, body gestures, and gestures. Traditional emotion recognition systems…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Haoyang Liu

While text-based emotion recognition methods have achieved notable success, real-world dialogue systems often demand a more nuanced emotional understanding than any single modality can offer. Multimodal Emotion Recognition in Conversations…

Computation and Language · Computer Science 2025-09-10 Chengyan Wu , Yiqiang Cai , Yang Liu , Pengxu Zhu , Yun Xue , Ziwei Gong , Julia Hirschberg , Bolei Ma

In this paper, we propose a two-layered multi-task attention based neural network that performs sentiment analysis through emotion analysis. The proposed approach is based on Bidirectional Long Short-Term Memory and uses Distributional…

Computation and Language · Computer Science 2019-12-02 Abhishek Kumar , Asif Ekbal , Daisuke Kawahra , Sadao Kurohashi

The Complex Emotion Recognition System (CERS) deciphers complex emotional states by examining combinations of basic emotions expressed, their interconnections, and the dynamic variations. Through the utilization of advanced algorithms, CERS…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Javad Hassannataj Joloudari , Mohammad Maftoun , Bahareh Nakisa , Roohallah Alizadehsani , Meisam Yadollahzadeh-Tabari

Recent advances in neurosciences and psychology have provided evidence that affective phenomena pervade intelligence at many levels, being inseparable from the cognitionaction loop. Perception, attention, memory, learning, decisionmaking,…

Artificial Intelligence · Computer Science 2008-09-30 Luis Paulo Reis , Daria Barteneva , Nuno Lau

We present M3ER, a learning-based method for emotion recognition from multiple input modalities. Our approach combines cues from multiple co-occurring modalities (such as face, text, and speech) and also is more robust than other methods to…

Signal Processing · Electrical Eng. & Systems 2019-11-25 Trisha Mittal , Uttaran Bhattacharya , Rohan Chandra , Aniket Bera , Dinesh Manocha