English
Related papers

Related papers: EMOD: A Unified EEG Emotion Representation Framewo…

200 papers

The detection of emotions using an Electroencephalogram (EEG) is a crucial area in brain-computer interfaces and has valuable applications in fields such as rehabilitation and medicine. In this study, we employed transfer learning to…

Signal Processing · Electrical Eng. & Systems 2024-04-09 Sidharth Sidharth , Ashish Abraham Samuel , Ranjana H , Jerrin Thomas Panachakel , Sana Parveen K

Emotion recognition is an important component of affective computing, and also human-machine interaction. Unimodal emotion recognition is convenient, but the accuracy may not be high enough; on the contrary, multi-modal emotion recognition…

Human-Computer Interaction · Computer Science 2026-02-12 Siyuan Kan , Huanyu Wu , Zhenyao Cui , Fan Huang , Xiaolong Xu , Dongrui Wu

Emotion recognition (ER) from speech signals is a robust approach since it cannot be imitated like facial expression or text based sentiment analysis. Valuable information underlying the emotions are significant for human-computer…

Sound · Computer Science 2023-12-19 David Hason Rudd , Huan Huo , Guandong Xu

Physiological signals such as electrocardiograms (ECG) and electroencephalograms (EEG) provide complementary insights into human health and cognition, yet multi-modal integration is challenging due to limited multi-modal labeled data, and…

Deep learning models perform best with abundant, high-quality labels, yet such conditions are rarely achievable in EEG-based emotion recognition. Electroencephalogram (EEG) signals are easily corrupted by artifacts and individual…

Machine Learning · Computer Science 2025-11-20 Hyo-Jeong Jang , Hye-Bin Shin , Kang Yin

We introduce a novel multimodal emotion recognition dataset that enhances the precision of Valence-Arousal Model while accounting for individual differences. This dataset includes electroencephalography (EEG), electrocardiography (ECG), and…

Human-Computer Interaction · Computer Science 2025-03-24 Xin Huang , Shiyao Zhu , Ziyu Wang , Yaping He , Hao Jin , Zhengkui Liu

Effectiveness of speech emotion recognition in real-world scenarios is often hindered by noisy environments and variability across datasets. This paper introduces a two-step approach to enhance the robustness and generalization of speech…

Sound · Computer Science 2025-10-13 Upasana Tiwari , Rupayan Chakraborty , Sunil Kumar Kopparapu

Most current audio-visual emotion recognition models lack the flexibility needed for deployment in practical applications. We envision a multimodal system that works even when only one modality is available and can be implemented…

Machine Learning · Computer Science 2026-01-13 Lucas Goncalves , Seong-Gyun Leem , Wei-Cheng Lin , Berrak Sisman , Carlos Busso

Emotion recognition using electroencephalogram (EEG) signals has broad potential across various domains. EEG signals have ability to capture rich spatial information related to brain activity, yet effectively modeling and utilizing these…

Human-Computer Interaction · Computer Science 2025-01-28 Yuzhe Zhang , Chengxi Xie , Huan Liu , Yuhan Shi , Dalin Zhang

Multimodal emotion understanding requires effective integration of text, audio, and visual modalities for both discrete emotion recognition and continuous sentiment analysis. We present EGMF, a unified framework combining expert-guided…

Computation and Language · Computer Science 2026-01-13 Jiaqi Qiao , Xiujuan Xu , Xinran Li , Yu Liu

Electroencephalography (EEG)-based emotion recognition plays a critical role in affective computing and emerging decision-support systems, yet remains challenging due to high-dimensional, noisy, and subject-dependent signals. This study…

Machine Learning · Computer Science 2026-02-09 S M Rakib UI Karim , Wenyi Lu , Diponkor Bala , Rownak Ara Rasul , Sean Goggins

The affective brain-computer interface is a crucial technology for affective interaction and emotional intelligence, emerging as a significant area of research in the human-computer interaction. Compared to single-type features, multi-type…

Human-Computer Interaction · Computer Science 2025-08-11 Xueyuan Xu , Wenjia Dong , Fulin Wei , Li Zhuo

Visual emotion analysis holds significant research value in both computer vision and psychology. However, existing methods for visual emotion analysis suffer from limited generalizability due to the ambiguity of emotion perception and the…

Artificial Intelligence · Computer Science 2025-07-21 Chuang Chen , Xiao Sun , Zhi Liu

Emotion recognition is an important research direction in artificial intelligence, helping machines understand and adapt to human emotional states. Multimodal electrophysiological(ME) signals, such as EEG, GSR, respiration(Resp), and…

Multimedia · Computer Science 2023-08-07 Yunfei Guo , Tao Zhang , Wu Huang

Electroencephalography (EEG) is an objective tool for emotion recognition and shows promising performance. However, the label scarcity problem is a main challenge in this field, which limits the wide application of EEG-based emotion…

Signal Processing · Electrical Eng. & Systems 2024-09-02 Rushuang Zhou , Weishan Ye , Zhiguo Zhang , Yanyang Luo , Li Zhang , Linling Li , Gan Huang , Yining Dong , Yuan-Ting Zhang , Zhen Liang

Task-specific pre-training is essential when task representations diverge from generic pre-training features. Existing task-general pre-training EEG models struggle with complex tasks like emotion recognition due to mismatches between…

Machine Learning · Computer Science 2025-10-28 Qingzhu Zhang , Jiani Zhong , Zongsheng Li , Xinke Shen , Quanying Liu

Driver emotion recognition plays a crucial role in driver monitoring systems, enhancing human-autonomy interactions and the trustworthiness of Autonomous Driving (AD). Various physiological and behavioural modalities have been explored for…

Machine Learning · Computer Science 2025-03-04 Nastaran Mansourian , Arash Mohammadi , M. Omair Ahmad , M. N. S. Swamy

Studies in the area of neuroscience have revealed the relationship between emotional patterns and brain functional regions, demonstrating that dynamic relationships between different brain regions are an essential factor affecting emotion…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Yijin Zhou , Fu Li , Yang Li , Youshuo Ji , Guangming Shi , Wenming Zheng , Lijian Zhang , Yuanfang Chen , Rui Cheng

We exploit a self-supervised deep multi-task learning framework for electrocardiogram (ECG) -based emotion recognition. The proposed solution consists of two stages of learning a) learning ECG representations and b) learning to classify…

Signal Processing · Electrical Eng. & Systems 2020-08-11 Pritam Sarkar , Ali Etemad

Emotion decoding using Electroencephalography (EEG)-based affective brain-computer interfaces (aBCIs) plays a crucial role in affective computing but is limited by challenges such as EEG's non-stationarity, individual variability, and the…

Human-Computer Interaction · Computer Science 2025-06-25 Ting Luo , Jing Zhang , Yingwei Qiu , Li Zhang , Yaohua Hu , Zhuliang Yu , Zhen Liang