English
Related papers

Related papers: EMOD: A Unified EEG Emotion Representation Framewo…

200 papers

Automated emotion recognition in speech is a long-standing problem. While early work on emotion recognition relied on hand-crafted features and simple classifiers, the field has now embraced end-to-end feature learning and classification…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-10 Ravi Shankar , Abdouh Harouna Kenfack , Arjun Somayazulu , Archana Venkataraman

To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals.…

Human-Computer Interaction · Computer Science 2016-02-29 Wei Liu , Wei-Long Zheng , Bao-Liang Lu

Detecting emotional inconsistency across modalities is a key challenge in affective computing, as speech and text often convey conflicting cues. Existing approaches generally rely on incomplete emotion representations and employ…

Multimedia · Computer Science 2025-09-25 Zongyi Li , Junchuan Zhao , Francis Bu Sung Lee , Andrew Zi Han Yee

One of the most significant challenges of EEG-based emotion recognition is the cross-subject EEG variations, leading to poor performance and generalizability. This paper proposes a novel EEG-based emotion recognition model called the domain…

Signal Processing · Electrical Eng. & Systems 2022-03-01 Tao Xu , Wang Dang , Jiabao Wang , Yun Zhou

In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expressions. This study explores the potential for detecting a…

Multimedia · Computer Science 2025-05-13 Jiehui Jia , Huan Zhang , Jinhua Liang

We propose a new representation learning solution for the classification of cognitive load based on Electroencephalogram (EEG). Our method integrates both time and frequency domains by first passing the raw EEG signals through the…

Human-Computer Interaction · Computer Science 2025-11-18 Prithila Angkan , Amin Jalali , Paul Hungler , Ali Etemad

Multimodal Emotion Recognition (MER) is a critical research area that seeks to decode human emotions from diverse data modalities. However, existing machine learning methods predominantly rely on predefined emotion taxonomies, which fail to…

Human-Computer Interaction · Computer Science 2025-05-08 Zheng Lian , Haiyang Sun , Licai Sun , Haoyu Chen , Lan Chen , Hao Gu , Zhuofan Wen , Shun Chen , Siyuan Zhang , Hailiang Yao , Bin Liu , Rui Liu , Shan Liang , Ya Li , Jiangyan Yi , Jianhua Tao

Emotion recognition has a wide range of applications in human-computer interaction, marketing, healthcare, and other fields. In recent years, the development of deep learning technology has provided new methods for emotion recognition.…

Computation and Language · Computer Science 2025-01-28 Junwei Feng , Xueyan Fan

The high temporal resolution and the asymmetric spatial activations are essential attributes of electroencephalogram (EEG) underlying emotional processes in the brain. To learn the temporal dynamics and spatial asymmetry of EEG towards…

Machine Learning · Computer Science 2022-04-26 Yi Ding , Neethu Robinson , Su Zhang , Qiuhao Zeng , Cuntai Guan

Automatic emotion recognition is a challenging task. In this paper, we present our effort for the audio-video based sub-challenge of the Emotion Recognition in the Wild (EmotiW) 2018 challenge, which requires participants to assign a single…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Zheng Lian , Ya Li , Jianhua Tao , Jian Huang

This study introduces a novel Supervised Info-enhanced Contrastive Learning framework for EEG based Emotion Recognition (SICLEER). SI-CLEER employs multi-granularity contrastive learning to create robust EEG contextual representations,…

Machine Learning · Computer Science 2024-05-14 Xiang Li , Jian Song , Zhigang Zhao , Chunxiao Wang , Dawei Song , Bin Hu

Depression is a widespread mental health disorder, yet its automatic detection remains challenging. Prior work has explored unimodal and multimodal approaches, with multimodal systems showing promise by leveraging complementary signals.…

Artificial Intelligence · Computer Science 2026-03-24 Annisaa Fitri Nurfidausi , Eleonora Mancini , Paolo Torroni

Deep learning has been widely adopted in automatic emotion recognition and has lead to significant progress in the field. However, due to insufficient annotated emotion datasets, pre-trained models are limited in their generalization…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , David Dean , Clinton Fookes

Emotions are one of the important components of the human being, thus they are a valuable part of daily activities such as interaction with people, decision making and learning. For this reason, it is important to detect, recognize and…

Human-Computer Interaction · Computer Science 2025-12-30 Ricardo Vasquez , Diego Riofrío-Luzcando , Joe Carrion-Jumbo , Cesar Guevara

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

Physiological signals that provide the objective repression of human affective states are attracted increasing attention in the emotion recognition field. However, the single signal is difficult to obtain completely and accurately…

Machine Learning · Computer Science 2020-01-03 Jing Zhang , Yong Zhang , Suhua Zhan , Cheng Cheng

How to effectively and efficiently extract valid and reliable features from high-dimensional electroencephalography (EEG), particularly how to fuse the spatial and temporal dynamic brain information into a better feature representation, is…

Human-Computer Interaction · Computer Science 2021-10-04 Zhen Liang , Rushuang Zhou , Li Zhang , Linling Li , Gan Huang , Zhiguo Zhang , Shin Ishii

Affective computing is an important branch of artificial intelligence, and with the rapid development of brain computer interface technology, emotion recognition based on EEG signals has received broad attention. It is still a great…

Signal Processing · Electrical Eng. & Systems 2022-12-26 Yongling Xu , Yang Du , Jing Zou , Tianying Zhou , Lushan Xiao , Li Liu , Pengcheng

In order to exploit representations of time-series signals, such as physiological signals, it is essential that these representations capture relevant information from the whole signal. In this work, we propose to use a Transformer-based…

Neurons and Cognition · Quantitative Biology 2022-06-06 Juan Vazquez-Rodriguez , Grégoire Lefebvre , Julien Cumin , James L. Crowley

Emotion recognition from electroencephalography (EEG) signals remains challenging due to high inter-subject variability, limited labeled data, and the lack of interpretable reasoning in existing approaches. While recent multimodal large…

Machine Learning · Computer Science 2026-01-14 Fei Ma , Han Lin , Yifan Xie , Hongwei Ren , Xiaoyu Shen , Wenbo Ding , Qi Tian