English
Related papers

Related papers: ExpressNet-MoE: A Hybrid Deep Neural Network for E…

200 papers

Convolutional neural networks (CNNs) can automatically learn data patterns to express face images for facial expression recognition (FER). However, they may ignore effect of facial segmentation of FER. In this paper, we propose a perception…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Chunwei Tian , Jingyuan Xie , Lingjun Li , Wangmeng Zuo , Yanning Zhang , David Zhang

To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals.…

Human-Computer Interaction · Computer Science 2016-02-29 Wei Liu , Wei-Long Zheng , Bao-Liang Lu

Using mel-spectrograms over conventional MFCCs features, we assess the abilities of convolutional neural networks to accurately recognize and classify emotions from speech data. We introduce FSER, a speech emotion recognition model trained…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Bonaventure F. P. Dossou , Yeno K. S. Gbenou

Visual emotion analysis or recognition has gained considerable attention due to the growing interest in understanding how images can convey rich semantics and evoke emotions in human perception. However, visual emotion analysis poses…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Rahul Singh Maharjan , Marta Romeo , Angelo Cangelosi

How to effectively and efficiently extract valid and reliable features from high-dimensional electroencephalography (EEG), particularly how to fuse the spatial and temporal dynamic brain information into a better feature representation, is…

Human-Computer Interaction · Computer Science 2021-10-04 Zhen Liang , Rushuang Zhou , Li Zhang , Linling Li , Gan Huang , Zhiguo Zhang , Shin Ishii

The generation of talking avatars has achieved significant advancements in precise audio synchronization. However, crafting lifelike talking head videos requires capturing a broad spectrum of emotions and subtle facial expressions. Current…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Huaize Liu , Wenzhang Sun , Donglin Di , Shibo Sun , Jiahui Yang , Changqing Zou , Hujun Bao

Classifying group-level emotions is a challenging task due to complexity of video, in which not only visual, but also audio information should be taken into consideration. Existing works on multimodal emotion recognition are using bulky…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Lev Evtodienko

Facial expressions vary from person to person, and the brightness, contrast, and resolution of every random image are different. This is why recognizing facial expressions is very difficult. This article proposes an efficient system for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Faisal Ghaffar

In this manuscript, the topic of multi-corpus Speech Emotion Recognition (SER) is approached from a deep transfer learning perspective. A large corpus of emotional speech data, EmoSet, is assembled from a number of existing SER corpora. In…

Sound · Computer Science 2021-03-16 Maurice Gerczuk , Shahin Amiriparian , Sandra Ottl , Björn Schuller

Multimodal emotion recognition is crucial for future human-computer interaction. However, accurate emotion recognition still faces significant challenges due to differences between different modalities and the difficulty of characterizing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Haoyang Zhang , Zhou Yang , Ke Sun , Yucai Pang , Guoliang Xu

Emotion Recognition in Conversations (ERC) has considerable prospects for developing empathetic machines. For multimodal ERC, it is vital to understand context and fuse modality information in conversations. Recent graph-based fusion…

Computation and Language · Computer Science 2022-03-07 Dou Hu , Xiaolong Hou , Lingwei Wei , Lianxin Jiang , Yang Mo

Automatic facial expression recognition is an important research area in the emotion recognition and computer vision. Applications can be found in several domains such as medical treatment, driver fatigue surveillance, sociable robotics,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Sevegni Odilon Clement Allognon , Alessandro L. Koerich , Alceu de S. Britto

Emotion recognition based on electroencephalography (EEG) has received attention as a way to implement human-centric services. However, there is still much room for improvement, particularly in terms of the recognition accuracy. In this…

Human-Computer Interaction · Computer Science 2018-09-13 Seong-Eun Moon , Soobeom Jang , Jong-Seok Lee

Micro-expressions (MEs) are involuntary facial movements revealing people's hidden feelings in high-stake situations and have practical importance in medical treatment, national security, interrogations and many human-computer interaction…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yante Li , Jinsheng Wei , Yang Liu , Janne Kauttonen , Guoying Zhao

Micro-expression recognition can obtain the real emotion of the individual at the current moment. Although deep learning-based methods, especially Transformer-based methods, have achieved impressive results, these methods have high…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Junbo Wang , Liangyu Fu , Yuke Li , Yining Zhu , Xuecheng Wu , Kun Hu

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

Applications in behavioural research, human-computer interaction, and mental health depend on the ability to recognize emotions. In order to improve the accuracy of emotion recognition using electroencephalography (EEG) data, this work…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Ali Asgar Chandanwala , Srutakirti Bhowmik , Parna Chaudhury , Sheena Christabel Pravin

Facial expression recognition (FER) aims to analyze emotional states from static images and dynamic sequences, which is pivotal in enhancing anthropomorphic communication among humans, robots, and digital avatars by leveraging AI…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Yan Wang , Shaoqi Yan , Yang Liu , Wei Song , Jing Liu , Yang Chang , Xinji Mai , Xiping Hu , Wenqiang Zhang , Zhongxue Gan

Facial expression recognition (FER) is an important research topic in emotional artificial intelligence. In recent decades, researchers have made remarkable progress. However, current FER paradigms face challenges in generalization, lack…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Bohao Xing , Zitong Yu , Xin Liu , Kaishen Yuan , Qilang Ye , Weicheng Xie , Huanjing Yue , Jingyu Yang , Heikki Kälviäinen

Unlike macro-expression, micro-expression does not follow a strictly consistent mapping rule between emotions and Action Units (AUs). As a result, some micro-expressions share identical AUs yet represent completely opposite emotional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chenxing Hu , Kun Xie , Qiguang Miao , Ruyi Liu , Quan Wang , Zongkai Yang