English
Related papers

Related papers: VR Based Emotion Recognition Using Deep Multimodal…

200 papers

Automatic emotion recognition has become increasingly important with the rise of AI, especially in fields like healthcare, education, and automotive systems. However, there is a lack of multimodal datasets, particularly involving body…

Artificial Intelligence · Computer Science 2025-09-09 Seyed Muhammad Hossein Mousavi , Atiye Ilanloo

We introduce a novel multimodal emotion recognition dataset that enhances the precision of Valence-Arousal Model while accounting for individual differences. This dataset includes electroencephalography (EEG), electrocardiography (ECG), and…

Human-Computer Interaction · Computer Science 2025-03-24 Xin Huang , Shiyao Zhu , Ziyu Wang , Yaping He , Hao Jin , Zhengkui Liu

Recent advancements in EEG-based emotion recognition have shown promising outcomes using both deep learning and classical machine learning approaches; however, most existing studies focus narrowly on binary valence prediction or…

Machine Learning · Computer Science 2025-09-01 Abdul Rehman , Ilona Heldal , Jerry Chun-Wei Lin

Emotion recognition technology is crucial in providing a personalized user experience. It is especially important in virtual reality(VR) to assess the user's emotions to enhance their sense of immersion. We propose an emotion recognition…

Human-Computer Interaction · Computer Science 2019-12-04 Jaehyun Nam , Hyesun Chung , Young ah Seong , Honggu Lee

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

Our experiment adapts several popular deep learning methods as well as some traditional methods on the problem of video emotion recognition. In our experiment, we use the CNN-LSTM architecture for visual information extraction and…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Lijie Fan , Yunjie Ke

Many individuals especially those with autism spectrum disorder (ASD), alexithymia, or other neurodivergent profiles face challenges in recognizing, expressing, or interpreting emotions. To support more inclusive and personalized emotion…

Human-Computer Interaction · Computer Science 2025-08-14 Von Ralph Dane Marquez Herbuela , Yukie Nagai

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

The emotion detection technology to enhance human decision-making is an important research issue for real-world applications, but real-life emotion datasets are relatively rare and small. The experiments conducted in this paper use the…

Computation and Language · Computer Science 2023-06-13 Théo Deschamps-Berger , Lori Lamel , Laurence Devillers

With the growing integration of human-computer interaction into everyday life, advances in machine learning have enabled systems to better perceive and respond to users' emotional states. Most existing affect recognition datasets focus on…

Machine Learning · Computer Science 2026-05-04 Karim Alghoul , Faisal Mohd , Fedwa Laamarti , Hussein Al Osman , Abdulmotaleb El Saddik

This paper discusses the benefits of incorporating multimodal data for improving latent emotion recognition accuracy, focusing on micro-expression (ME) and physiological signals (PS). The proposed approach presents a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Liangfei Zhang , Yifei Qian , Ognjen Arandjelovic , Anthony Zhu

Automatic emotion recognition (ER) has recently gained lot of interest due to its potential in many real-world applications. In this context, multimodal approaches have been shown to improve performance (over unimodal approaches) by…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 R Gnana Praveen , Eric Granger , Patrick Cardinal

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Multimodal sentiment analysis utilizes multiple heterogeneous modalities for sentiment classification. The recent multimodal fusion schemes customize LSTMs to discover intra-modal dynamics and design sophisticated attention mechanisms to…

Artificial Intelligence · Computer Science 2020-10-19 Sunny Verma , Jiwei Wang , Zhefeng Ge , Rujia Shen , Fan Jin , Yang Wang , Fang Chen , Wei Liu

Multi-modal sentiment analysis plays an important role for providing better interactive experiences to users. Each modality in multi-modal data can provide different viewpoints or reveal unique aspects of a user's emotional state. In this…

Machine Learning · Computer Science 2021-06-23 Debapriya Banerjee , Fotios Lygerakis , Fillia Makedon

Emotion understanding is a complex process that involves multiple components. The ability to recognise emotions not only leads to new context awareness methods but also enhances system interaction's effectiveness by perceiving and…

Human-Computer Interaction · Computer Science 2024-10-27 Rukshani Somarathna , Gelareh Mohammadi

This paper focuses on two key problems for audio-visual emotion recognition in the video. One is the audio and visual streams temporal alignment for feature level fusion. The other one is locating and re-weighting the perception attentions…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Linlin Chao , Jianhua Tao , Minghao Yang , Ya Li , Zhengqi Wen

Emotion recognition from electroencephalogram (EEG) signals is a thriving field, particularly in neuroscience and Human-Computer Interaction (HCI). This study aims to understand and improve the predictive accuracy of emotional state…

Machine Learning · Computer Science 2025-08-13 Shyam K Sateesh , Sparsh BK , Uma D

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

Human-Computer Interaction · Computer Science 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie
‹ Prev 1 2 3 10 Next ›