English
Related papers

Related papers: Meta-Auxiliary Learning for Micro-Expression Recog…

200 papers

In this paper, a deep learning framework is proposed for automatic facial emotion based on deep convolutional networks. In order to increase the generalization ability and the robustness of the method, the dataset size is increased by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Serap Kırbız

Emotions manifest through physical experiences and bodily reactions, yet identifying such embodied emotions in text remains understudied. We present an embodied emotion classification dataset, CHEER-Ekman, extending the existing binary…

Computation and Language · Computer Science 2025-09-26 Phan Anh Duong , Cat Luong , Divyesh Bommana , Tianyu Jiang

Descriptive Multimodal Emotion Recognition (DMER) has garnered increasing research attention. Unlike traditional discriminative paradigms that rely on predefined emotion taxonomies, DMER aims to describe human emotional state using…

Human-Computer Interaction · Computer Science 2025-09-29 Zheng Lian , Licai Sun , Lan Chen , Haoyu Chen , Zebang Cheng , Fan Zhang , Ziyu Jia , Ziyang Ma , Fei Ma , Xiaojiang Peng , Jianhua Tao

Facial micro-expressions (MEs) are involuntary movements of the face that occur spontaneously when a person experiences an emotion but attempts to suppress or repress the facial expression, typically found in a high-stakes environment. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xinqi Fan , Jingting Li , John See , Moi Hoon Yap , Su-Jing Wang , Adrian K. Davison

Facial expression data is characterized by a significant imbalance, with most collected data showing happy or neutral expressions and fewer instances of fear or disgust. This imbalance poses challenges to facial expression recognition (FER)…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yuhang Zhang , Yaqi Li , Lixiong Qin , Xuannan Liu , Weihong Deng

Multimodal emotion recognition plays a key role in many domains, including mental health monitoring, educational interaction, and human-computer interaction. However, existing methods often face three major challenges: unbalanced category…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Feng Li , Ke Wu , Yongwei Li

Accurate speech emotion recognition is essential for developing human-facing systems. Recent advancements have included finetuning large, pretrained transformer models like Wav2Vec 2.0. However, the finetuning process requires substantial…

Sound · Computer Science 2025-03-07 Aneesha Sampath , James Tavernor , Emily Mower Provost

Compound Expression Recognition (CER) is vital for effective interpersonal interactions. Human emotional expressions are inherently complex due to the presence of compound expressions, requiring the consideration of both local and global…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Xuxiong Liu , Kang Shen , Jun Yao , Boyan Wang , Minrui Liu , Liuwei An , Zishun Cui , Weijie Feng , Xiao Sun

Symbolic Music Emotion Recognition(SMER) is to predict music emotion from symbolic data, such as MIDI and MusicXML. Previous work mainly focused on learning better representation via (mask) language model pre-training but ignored the…

Sound · Computer Science 2022-01-19 Jibao Qiu , C. L. Philip Chen , Tong Zhang

Deep learning has been widely adopted in automatic emotion recognition and has lead to significant progress in the field. However, due to insufficient annotated emotion datasets, pre-trained models are limited in their generalization…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , David Dean , Clinton Fookes

Micro-expression recognition (MER) aims to recognize the short and subtle facial movements from the Micro-expression (ME) video clips, which reveal real emotions. Recent MER methods mostly only utilize special frames from ME video clips or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Haihong Hao , Shuo Wang , Huixia Ben , Yanbin Hao , Yansong Wang , Weiwei Wang

Inspite the emerging importance of Speech Emotion Recognition (SER), the state-of-the-art accuracy is quite low and needs improvement to make commercial applications of SER viable. A key underlying reason for the low accuracy is the…

Sound · Computer Science 2020-03-24 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Julien Epps , Björn W. Schuller

The Complex Emotion Recognition System (CERS) deciphers complex emotional states by examining combinations of basic emotions expressed, their interconnections, and the dynamic variations. Through the utilization of advanced algorithms, CERS…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Javad Hassannataj Joloudari , Mohammad Maftoun , Bahareh Nakisa , Roohallah Alizadehsani , Meisam Yadollahzadeh-Tabari

Meta-learning approaches have shown great success in vision and language domains. However, few studies discuss the practice of meta-learning for large-scale industrial applications. Although e-commerce companies have spent many efforts on…

Machine Learning · Computer Science 2020-10-12 Hao Gong , Qifang Zhao , Tianyu Li , Derek Cho , DuyKhuong Nguyen

Multi-modal Multi-label Emotion Recognition (MMER) aims to identify various human emotions from heterogeneous visual, audio and text modalities. Previous methods mainly focus on projecting multiple modalities into a common latent space and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yi Zhang , Mingyuan Chen , Jundong Shen , Chongjun Wang

Benefiting from the vigorous development of deep learning, many CNN-based image super-resolution methods have emerged and achieved better results than traditional algorithms. However, it is difficult for most algorithms to adaptively adjust…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yuxi Cai , Huicheng Lai , Zhenghong Jia

Understanding human affective behaviour, especially in the dynamics of real-world settings, requires Facial Expression Recognition (FER) models to continuously adapt to individual differences in user expression, contextual attributions, and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Nikhil Churamani , Tolga Dimlioglu , German I. Parisi , Hatice Gunes

A micro-expression is a spontaneous unconscious facial muscle movement that can reveal the true emotions people attempt to hide. Although manual methods have made good progress and deep learning is gaining prominence. Due to the short…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Fengping Wang , Jie Li , Chun Qi , Lin Wang , Pan Wang

We propose a novel transfer learning method for speech emotion recognition allowing us to obtain promising results when only few training data is available. With as low as 125 examples per emotion class, we were able to reach a higher…

Machine Learning · Computer Science 2020-11-12 Jonathan Boigne , Biman Liyanage , Ted Östrem

Traditional techniques for emotion recognition have focused on the facial expression analysis only, thus providing limited ability to encode context that comprehensively represents the emotional responses. We present deep networks for…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Jiyoung Lee , Seungryong Kim , Sunok Kim , Jungin Park , Kwanghoon Sohn