English
Related papers

Related papers: Emotion recognition based on multi-modal electroph…

200 papers

Emotion estimation in music listening is confronting challenges to capture the emotion variation of listeners. Recent years have witnessed attempts to exploit multimodality fusing information from musical contents and physiological signals…

Artificial Intelligence · Computer Science 2016-12-01 Nattapong Thammasan , Ken-ichi Fukui , Masayuki Numao

Affective computing is a rapidly developing interdisciplinary research direction in the field of brain-computer interface. In recent years, the introduction of deep learning technology has greatly promoted the development of the field of…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Guangli Li , Canbiao Wu , Zhen Liang

Emotion Recognition in Conversation (ERC) involves detecting the underlying emotion behind each utterance within a conversation. Effectively generating representations for utterances remains a significant challenge in this task. Recent…

Computation and Language · Computer Science 2024-04-01 Fangxu Yu , Junjie Guo , Zhen Wu , Xinyu Dai

Using deep learning methods to classify EEG signals can accurately identify people's emotions. However, existing studies have rarely considered the application of the information in another domain's representations to feature selection in…

Signal Processing · Electrical Eng. & Systems 2023-03-22 Kexin Zhu , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Multimodal emotion recognition is crucial for future human-computer interaction. However, accurate emotion recognition still faces significant challenges due to differences between different modalities and the difficulty of characterizing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Haoyang Zhang , Zhou Yang , Ke Sun , Yucai Pang , Guoliang Xu

Electroencephalography (EEG) signals provide a promising and involuntary reflection of brain activity related to emotional states, offering significant advantages over behavioral cues like facial expressions. However, EEG signals are often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Kai Cui , Jia Li , Yu Liu , Xuesong Zhang , Zhenzhen Hu , Meng Wang

With the release of increasing open-source emotion recognition datasets on social media platforms and the rapid development of computing resources, multimodal emotion recognition tasks (MER) have begun to receive widespread research…

Computation and Language · Computer Science 2024-09-04 Yuntao Shou , Tao Meng , Wei Ai , Nan Yin , Keqin Li

Cross-corpus speech emotion recognition (SER) seeks to generalize the ability of inferring speech emotion from a well-labeled corpus to an unlabeled one, which is a rather challenging task due to the significant discrepancy between two…

Sound · Computer Science 2023-08-07 Jiaxin Ye , Yujie Wei , Xin-Cheng Wen , Chenglong Ma , Zhizhong Huang , Kunhong Liu , Hongming Shan

There has been an encouraging progress in the affective states recognition models based on the single-modality signals as electroencephalogram (EEG) signals or peripheral physiological signals in recent years. However, multimodal…

Signal Processing · Electrical Eng. & Systems 2023-06-02 Yuxuan Zhao , Xinyan Cao , Jinlong Lin , Dunshan Yu , Xixin Cao

Multimodal emotion recognition is a challenging research area that aims to fuse different modalities to predict human emotion. However, most existing models that are based on attention mechanisms have difficulty in learning emotionally…

Computation and Language · Computer Science 2023-03-08 Zihan Zhao , Yu Wang , Yanfeng Wang

We exploit a self-supervised deep multi-task learning framework for electrocardiogram (ECG) -based emotion recognition. The proposed solution consists of two stages of learning a) learning ECG representations and b) learning to classify…

Signal Processing · Electrical Eng. & Systems 2020-08-11 Pritam Sarkar , Ali Etemad

The Multimodal Emotion Recognition challenge MER2024 focuses on recognizing emotions using audio, language, and visual signals. In this paper, we present our submission solutions for the Semi-Supervised Learning Sub-Challenge…

Sound · Computer Science 2024-09-10 Qi Fan , Yutong Li , Yi Xin , Xinyu Cheng , Guanglai Gao , Miao Ma

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

Human-Computer Interaction · Computer Science 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Decoding emotional states from human brain activity plays an important role in brain-computer interfaces. Existing emotion decoding methods still have two main limitations: one is only decoding a single emotion category from a brain…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Kaicheng Fu , Changde Du , Shengpei Wang , Huiguang He

Considerable attention has been paid for physiological signal-based emotion recognition in field of affective computing. For the reliability and user friendly acquisition, Electrodermal Activity (EDA) has great advantage in practical…

Sound · Computer Science 2022-05-16 Guanghao Yin , Shouqian Sun , Dian Yu , Dejian Li , Kejun Zhang

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Multimodal Emotion Recognition in Conversation (ERC) plays an influential role in the field of human-computer interaction and conversational robotics since it can motivate machines to provide empathetic services. Multimodal data modeling is…

Multimedia · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Electroencephalography (EEG) emotion recognition plays a crucial role in human-computer interaction, particularly in healthcare and neuroscience. While supervised learning has been widely used, its reliance on manual annotations introduces…

Signal Processing · Electrical Eng. & Systems 2025-09-03 Hanqi Wang , Yang Liu , Peng Ye , Liang Song

In this paper, a hardware-optimized approach to emotion recognition based on the efficient brain-inspired hyperdimensional computing (HDC) paradigm is proposed. Emotion recognition provides valuable information for human-computer…

Emerging Technologies · Computer Science 2021-04-08 Alisha Menon , Anirudh Natarajan , Reva Agashe , Daniel Sun , Melvin Aristio , Harrison Liew , Yakun Sophia Shao , Jan M. Rabaey

We present an electrocardiogram (ECG) -based emotion recognition system using self-supervised learning. Our proposed architecture consists of two main networks, a signal transformation recognition network and an emotion recognition network.…

Machine Learning · Computer Science 2020-04-14 Pritam Sarkar , Ali Etemad