English
Related papers

Related papers: Joint Contrastive Learning with Feature Alignment …

200 papers

Human emotions involve basic and compound facial expressions. However, current research on facial expression recognition (FER) mainly focuses on basic expressions, and thus fails to address the diversity of human emotions in practical…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Xinyi Zou , Yan Yan , Jing-Hao Xue , Si Chen , Hanzi Wang

An advanced emotion classification model was developed using a CNN-Transformer architecture for emotion recognition from EEG brain wave signals, effectively distinguishing among three emotional states, positive, neutral and negative. The…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Roman Dolgopolyi , Antonis Chatzipanagiotou

Multimodal emotion analysis performed better in emotion recognition depending on more comprehensive emotional clues and multimodal emotion dataset. In this paper, we developed a large multimodal emotion dataset, named "HED" dataset, to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhongyu Fang , Aoyun He , Qihui Yu , Baopeng Gao , Weiping Ding , Tong Zhang , Lei Ma

Physiological signals such as electrocardiograms (ECG) and electroencephalograms (EEG) provide complementary insights into human health and cognition, yet multi-modal integration is challenging due to limited multi-modal labeled data, and…

Among the different modalities to assess emotion, electroencephalogram (EEG), representing the electrical brain activity, achieved motivating results over the last decade. Emotion estimation from EEG could help in the diagnosis or…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Victor Delvigne , Antoine Facchini , Hazem Wannous , Thierry Dutoit , Laurence Ris , Jean-Philippe Vandeborre

Modern electronic health records (EHRs) hold immense promise in tracking personalized patient health trajectories through sequential deep learning, owing to their extensive breadth, scale, and temporal granularity. Nonetheless, how to…

ERP-based EEG detection is gaining increasing attention in the field of brain-computer interfaces. However, due to the complexity of ERP signal components, their low signal-to-noise ratio, and significant inter-subject variability,…

Signal Processing · Electrical Eng. & Systems 2024-07-09 Yuntian Cui , Xinke Shen , Dan Zhang , Chen Yang

Deep learning-based palmprint recognition algorithms have shown great potential. Most of them are mainly focused on identifying samples from the same dataset. However, they may be not suitable for a more convenient case that the images for…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Huikai Shao , Dexing Zhong

Traditional music search engines rely on retrieval methods that match natural language queries with music metadata. There have been increasing efforts to expand retrieval methods to consider the audio characteristics of music itself, using…

Multimedia · Computer Science 2024-12-10 Shanti Stewart , Kleanthis Avramidis , Tiantian Feng , Shrikanth Narayanan

Neural representations induced by naturalistic stimuli offer insights into how humans respond to stimuli in daily life. Understanding neural mechanisms underlying naturalistic stimuli processing hinges on the precise identification and…

Neurons and Cognition · Quantitative Biology 2024-07-16 Xinke Shen , Lingyi Tao , Xuyang Chen , Sen Song , Quanying Liu , Dan Zhang

Electroencephalography (EEG) is a popular and effective tool for emotion recognition. However, the propagation mechanisms of EEG in the human brain and its intrinsic correlation with emotions are still obscure to researchers. This work…

Robotics · Computer Science 2022-09-26 Jiyao Liu , Hao Wu , Li Zhang , Yanxi Zhao

Electroencephalogram (EEG) signals serve as a powerful tool in affective Brain-Computer Interfaces (aBCIs) and play a crucial role in affective computing. In recent years, the introduction of deep learning techniques has significantly…

Machine Learning · Computer Science 2025-08-08 Guangli Li , Canbiao Wu , Zhehao Zhou , Tuo Sun , Ping Tan , Li Zhang , Zhen Liang

Subject-independent EEG emotion recognition is challenged by pronounced inter-subject variability and the difficulty of learning robust representations from short, noisy recordings. To address this, we propose a fusion framework that…

Machine Learning · Computer Science 2026-01-14 Zheng Zhou , Isabella McEvoy , Camilo E. Valderrama

Electroencephalography (EEG) is an objective tool for emotion recognition with promising applications. However, the scarcity of labeled data remains a major challenge in this field, limiting the widespread use of EEG-based emotion…

Signal Processing · Electrical Eng. & Systems 2024-08-05 Weishan Ye , Zhiguo Zhang , Fei Teng , Min Zhang , Jianhong Wang , Dong Ni , Fali Li , Peng Xu , Zhen Liang

Emotion recognition is an important part of affective computing. Extracting emotional cues from human gaits yields benefits such as natural interaction, a nonintrusive nature, and remote detection. Recently, the introduction of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Cheng Song , Lu Lu , Zhen Ke , Long Gao , Shuai Ding

Multimodal emotion recognition plays a key role in many domains, including mental health monitoring, educational interaction, and human-computer interaction. However, existing methods often face three major challenges: unbalanced category…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Feng Li , Ke Wu , Yongwei Li

In this paper we propose a fusion approach to continuous emotion recognition that combines visual and auditory modalities in their representation spaces to predict the arousal and valence levels. The proposed approach employs a pre-trained…

Machine Learning · Computer Science 2019-06-26 Juan D. S. Ortega , Patrick Cardinal , Alessandro L. Koerich

In terms of human-computer interaction, it is becoming more and more important to correctly understand the user's emotional state in a conversation, so the task of multimodal emotion recognition (MER) started to receive more attention.…

Computation and Language · Computer Science 2024-01-04 Wei Ai , FuChen Zhang , Tao Meng , YunTao Shou , HongEn Shao , Keqin Li

Emotion recognition is an important component of affective computing, and also human-machine interaction. Unimodal emotion recognition is convenient, but the accuracy may not be high enough; on the contrary, multi-modal emotion recognition…

Human-Computer Interaction · Computer Science 2026-02-12 Siyuan Kan , Huanyu Wu , Zhenyao Cui , Fan Huang , Xiaolong Xu , Dongrui Wu

Computer interfaces are advancing towards using multi-modalities to enable better human-computer interactions. The use of automatic emotion recognition (AER) can make the interactions natural and meaningful thereby enhancing the user…

Sound · Computer Science 2025-03-26 Upasana Tiwari , Rupayan Chakraborty , Sunil Kumar Kopparapu