English
Related papers

Related papers: VR Based Emotion Recognition Using Deep Multimodal…

200 papers

Emotion recognition (ER) technology is an integral part for developing innovative applications such as drowsiness detection and health monitoring that plays a pivotal role in contemporary society. This study delves into ER using…

Human-Computer Interaction · Computer Science 2024-02-07 Haseeb ur Rahman Abbasi , Zeeshan Rashid , Muhammad Majid , Syed Muhammad Anwar

Understanding and recognizing emotions are important and challenging issues in the metaverse era. Understanding, identifying, and predicting fear, which is one of the fundamental human emotions, in virtual reality (VR) environments plays an…

Human-Computer Interaction · Computer Science 2025-05-14 He Zhang , Xinyang Li , Yuanxi Sun , Xinyi Fu , Christine Qiu , John M. Carroll

Continuous dimensional emotion prediction is a challenging task where the fusion of various modalities usually achieves state-of-the-art performance such as early fusion or late fusion. In this paper, we propose a novel multi-modal fusion…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Shizhe Chen , Qin Jin

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

In the recent past, deep learning-based approaches have significantly improved the classification accuracy when compared to classical signal processing and machine learning based frameworks. But most of them were subject-dependent studies…

Neural and Evolutionary Computing · Computer Science 2021-12-22 Arjun , Aniket Singh Rajpoot , Mahesh Raveendranatha Panicker

Automated emotion recognition in speech is a long-standing problem. While early work on emotion recognition relied on hand-crafted features and simple classifiers, the field has now embraced end-to-end feature learning and classification…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-10 Ravi Shankar , Abdouh Harouna Kenfack , Arjun Somayazulu , Archana Venkataraman

Emotion recognition has become an important research topic in the field of human-computer interaction. Studies on sound and videos to understand emotions focused mainly on analyzing facial expressions and classified 6 basic emotions. In…

Machine Learning · Computer Science 2023-06-23 Ege Kesim , Selahattin Serdar Helli , Sena Nur Cavsak

Deploying emotion recognition systems in real-world environments where devices must be small, low-power, and private remains a significant challenge. This is especially relevant for applications such as tension monitoring, conflict…

Emotion recognition is a critical task in human-computer interaction, enabling more intuitive and responsive systems. This study presents a multimodal emotion recognition system that combines low-level information from audio and text,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Shamin Bin Habib Avro , Taieba Taher , Nursadul Mamun

Human texture perception is a weighted average of multi-sensory inputs: visual and tactile. While the visual sensing mechanism extracts global features, the tactile mechanism complements it by extracting local features. The lack of coupled…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Prasanna Kumar Routray , Aditya Sanjiv Kanade , Jay Bhanushali , Manivannan Muniyandi

Empathetic and coherent responses are critical in auto-mated chatbot-facilitated psychotherapy. This study addresses the challenge of enhancing the emotional and contextual understanding of large language models (LLMs) in psychiatric…

Computation and Language · Computer Science 2025-03-12 Abdur Rasool , Muhammad Irfan Shahzad , Hafsa Aslam , Vincent Chan , Muhammad Ali Arshad

Emotion detection presents challenges to intelligent human-robot interaction (HRI). Foundational deep learning techniques used in emotion detection are limited by information-constrained datasets or models that lack the necessary complexity…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 David C. Jeong , Tianma Shen , Hongji Liu , Raghav Kapoor , Casey Nguyen , Song Liu , Christopher A. Kitts

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

Human-Computer Interaction · Computer Science 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

The automated detection of sexism in memes is a challenging task due to multimodal ambiguity, cultural nuance, and the use of humor to provide plausible deniability. Content-only models often fail to capture the complexity of human…

Human-Computer Interaction · Computer Science 2026-03-02 Iván Arcos , Paolo Rosso , Elena Gomis-Vicent

Using deep learning methods to classify EEG signals can accurately identify people's emotions. However, existing studies have rarely considered the application of the information in another domain's representations to feature selection in…

Signal Processing · Electrical Eng. & Systems 2023-03-22 Kexin Zhu , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Emotion detection in older adults is crucial for understanding their cognitive and emotional well-being, especially in hospital and assisted living environments. In this work, we investigate an edge-based, non-obtrusive approach to emotion…

Human-Computer Interaction · Computer Science 2025-07-14 Md. Saif Hassan Onim , Andrew M. Kiselica , Himanshu Thapliyal

Speech Emotion Recognition (SER) is a fundamental task to predict the emotion label from speech data. Recent works mostly focus on using convolutional neural networks~(CNNs) to learn local attention map on fixed-scale feature representation…

Sound · Computer Science 2022-04-13 Wenjing Zhu , Xiang Li

As the result of the growing importance of the Human Computer Interface system, understanding human's emotion states has become a consequential ability for the computer. This paper aims to improve the performance of emotion recognition by…

Quantitative Methods · Quantitative Biology 2018-09-25 Kuan Tung , Po-Kang Liu , Yu-Chuan Chuang , Sheng-Hui Wang , An-Yeu Wu

We investigate the feasibility of inferring emotional states exclusively from physiological signals, thereby presenting a privacy-preserving alternative to conventional facial recognition techniques. We conduct a performance comparison of…

Machine Learning · Computer Science 2025-07-14 Md. Saif Hassan Onim , Travis S. Humble , Himanshu Thapliyal