English
Related papers

Related papers: Cross-domain EEG-based Emotion Recognition with Co…

200 papers

Emotional Recognition in Conversation (ERC) is valuable for diagnosing health conditions such as autism and depression, and for understanding the emotions of individuals who struggle to express their feelings. Current ERC methods primarily…

Human-Computer Interaction · Computer Science 2026-05-06 Zijian Kang , Yueyang Li , Shengyu Gong , Weiming Zeng , Hongjie Yan , Lingbin Bian , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

In affective computing, the task of Emotion Recognition in Conversations (ERC) has emerged as a focal area of research. The primary objective of this task is to predict emotional states within conversations by analyzing multimodal data…

Multimedia · Computer Science 2024-11-22 Xiaomin Yu , Feiyang Wang , Ziyue Qiao

Speech Emotion Recognition (SER) is a fundamental task to predict the emotion label from speech data. Recent works mostly focus on using convolutional neural networks~(CNNs) to learn local attention map on fixed-scale feature representation…

Sound · Computer Science 2022-04-13 Wenjing Zhu , Xiang Li

Current emotion-based contrastive language-audio pretraining (CLAP) methods typically learn by na\"ively aligning audio samples with corresponding text prompts. Consequently, this approach fails to capture the ordinal nature of emotions,…

Machine Learning · Computer Science 2025-05-30 Shreeram Suresh Chandra , Lucas Goncalves , Junchen Lu , Carlos Busso , Berrak Sisman

Emotion recognition is crucial for advancing mental health, healthcare, and technologies like brain-computer interfaces (BCIs). However, EEG-based emotion recognition models face challenges in cross-domain applications due to the high cost…

Signal Processing · Electrical Eng. & Systems 2025-04-08 Md Niaz Imtiaz , Naimul Khan

Among the different modalities to assess emotion, electroencephalogram (EEG), representing the electrical brain activity, achieved motivating results over the last decade. Emotion estimation from EEG could help in the diagnosis or…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Victor Delvigne , Antoine Facchini , Hazem Wannous , Thierry Dutoit , Laurence Ris , Jean-Philippe Vandeborre

Compared with the rich studies on the motor brain-computer interface (BCI), the recently emerging affective BCI presents distinct challenges since the brain functional connectivity networks involving emotion are not well investigated.…

Human-Computer Interaction · Computer Science 2020-04-07 Xun Wu , Wei-Long Zheng , Bao-Liang Lu

CLIP has demonstrated strong generalization in visual domains through natural language supervision, even for video action recognition. However, most existing approaches that adapt CLIP for action recognition have primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Hyo Jin Jon , Longbin Jin , Eun Yi Kim

EEG-based Emotion recognition holds significant promise for applications in human-computer interaction, medicine, and neuroscience. While deep learning has shown potential in this field, current approaches usually rely on large-scale…

Signal Processing · Electrical Eng. & Systems 2024-03-08 Hanqi Wang , Tao Chen , Liang Song

Emotion recognition in conversations (ERC) is a rapidly evolving task within the natural language processing community, which aims to detect the emotions expressed by speakers during a conversation. Recently, a growing number of ERC methods…

Computation and Language · Computer Science 2023-12-12 Tao Shi , Xiao Liang , Yaoyuan Liang , Xinyi Tong , Shao-Lun Huang

Human affective behavior analysis aims to delve into human expressions and behaviors to deepen our understanding of human emotions. Basic expression categories (EXPR) and Action Units (AUs) are two essential components in this analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Li Lin , Sarah Papabathini , Xin Wang , Shu Hu

The research on human emotion under multimedia stimulation based on physiological signals is an emerging field, and important progress has been achieved for emotion recognition based on multi-modal signals. However, it is challenging to…

Machine Learning · Computer Science 2021-08-10 Ziyu Jia , Youfang Lin , Jing Wang , Zhiyang Feng , Xiangheng Xie , Caijie Chen

Multimodal emotion recognition plays a key role in many domains, including mental health monitoring, educational interaction, and human-computer interaction. However, existing methods often face three major challenges: unbalanced category…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Feng Li , Ke Wu , Yongwei Li

Epilepsy is a prevalent neurological disorder marked by sudden, brief episodes of excessive neuronal activity caused by abnormal electrical discharges, which may lead to some mental disorders. Most existing deep learning methods for…

Machine Learning · Computer Science 2025-10-16 Zexin Wang , Lin Shi , Haoyu Wu , Junru Luo , Xiangzeng Kong , Jun Qi

Electroencephalography (EEG) is a prominent non-invasive neuroimaging technique providing insights into brain function. Unfortunately, EEG data exhibit a high degree of noise and variability across subjects hampering generalizable signal…

Machine Learning · Computer Science 2023-11-15 Anders Vestergaard Nørskov , Alexander Neergaard Zahid , Morten Mørup

Electroencephalograph (EEG) emotion recognition is a significant task in the brain-computer interface field. Although many deep learning methods are proposed recently, it is still challenging to make full use of the information contained in…

Machine Learning · Computer Science 2021-01-15 Guowen Xiao , Mengwen Ye , Bowen Xu , Zhendi Chen , Quansheng Ren

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

We introduce eCLIP, an enhanced version of the CLIP model that integrates expert annotations in the form of radiologist eye-gaze heatmaps. It tackles key challenges in contrastive multi-modal medical imaging analysis, notably data scarcity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yogesh Kumar , Pekka Marttinen

Emotion recognition from physiological signals remains challenging due to their non-stationary, noisy, and subject-dependent characteristics. This work presents, to the best of our knowledge, the first comprehensive application of liquid…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Anindya Bhattacharjee , Nittya Ananda Biswas , K. A. Shahriar , Adib Rahman

Applications in behavioural research, human-computer interaction, and mental health depend on the ability to recognize emotions. In order to improve the accuracy of emotion recognition using electroencephalography (EEG) data, this work…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Ali Asgar Chandanwala , Srutakirti Bhowmik , Parna Chaudhury , Sheena Christabel Pravin