English
Related papers

Related papers: From Macro to Micro: Boosting micro-expression rec…

200 papers

Micro-expressions serve as essential cues for understanding individuals' genuine emotional states. Recognizing micro-expressions attracts increasing research attention due to its various applications in fields such as business negotiation…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Fengyuan Zhang , Zhaopei Huang , Xinjie Zhang , Qin Jin

Critical obstacles in training classifiers to detect facial actions are the limited sizes of annotated video databases and the relatively low frequencies of occurrence of many actions. To address these problems, we propose an approach that…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Koichiro Niinuma , Itir Onal Ertugrul , Jeffrey F Cohn , László A Jeni

Facial expression is an essential factor in conveying human emotional states and intentions. Although remarkable advancement has been made in facial expression recognition (FER) task, challenges due to large variations of expression…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Jie Lei , Zhao Liu , Zeyu Zou , Tong Li , Xu Juan , Shuaiwei Wang , Guoyu Yang , Zunlei Feng

Recent advances in video diffusion models have unlocked new potential for realistic audio-driven talking video generation. However, achieving seamless audio-lip synchronization, maintaining long-term identity consistency, and producing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Longtao Zheng , Yifan Zhang , Hanzhong Guo , Jiachun Pan , Zhenxiong Tan , Jiahao Lu , Chuanxin Tang , Bo An , Shuicheng Yan

This paper is aimed at creating extremely small and fast convolutional neural networks (CNN) for the problem of facial expression recognition (FER) from frontal face images. To this end, we employed the popular knowledge distillation (KD)…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 İlke Çuğu , Eren Şener , Emre Akbaş

Micro expression recognition (MER)is a very challenging task as the expression lives very short in nature and demands feature modeling with the involvement of both spatial and temporal dynamics. Existing MER systems exploit CNN networks to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Monu Verma , Santosh Kumar Vipparthi , Girdhari Singh

Facial micro-expression (ME) recognition has posed a huge challenge to researchers for its subtlety in motion and limited databases. Recently, handcrafted techniques have achieved superior performance in micro-expression recognition but at…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Huai-Qian Khor , John See , Raphael C. W. Phan , Weiyao Lin

Micro-expression recognition (MER) draws intensive research interest as micro-expressions (MEs) can infer genuine emotions. Prior information can guide the model to learn discriminative ME features effectively. However, most works focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Jinsheng Wei , Haoyu Chen , Guanming Lu , Jingjie Yan , Yue Xie , Guoying Zhao

In this paper, a deep learning framework is proposed for automatic facial emotion based on deep convolutional networks. In order to increase the generalization ability and the robustness of the method, the dataset size is increased by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Serap Kırbız

In this paper, we present a sparsity-aware deep network for automatic 4D facial expression recognition (FER). Given 4D data, we first propose a novel augmentation method to combat the data limitation problem for deep learning. This is…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Muzammil Behzad , Nhat Vo , Xiaobai Li , Guoying Zhao

In this paper, we propose MMER, a novel Multimodal Multi-task learning approach for Speech Emotion Recognition. MMER leverages a novel multimodal network based on early-fusion and cross-modal self-attention between text and acoustic…

Computation and Language · Computer Science 2023-06-06 Sreyan Ghosh , Utkarsh Tyagi , S Ramaneswaran , Harshvardhan Srivastava , Dinesh Manocha

Micro-expressions are hard to spot due to fleeting and involuntary moments of facial muscles. Interpretation of micro emotions from video clips is a challenging task. In this paper we propose an affective-motion imaging that cumulates rapid…

Multimedia · Computer Science 2021-04-16 Monu Verma , Santosh Kumar Vipparthi , Girdhari Singh

Multimodal Emotion Recognition (MER) aims to perceive human emotions through three modes: language, vision, and audio. Previous methods primarily focused on modal fusion without adequately addressing significant distributional differences…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Jichao Zhu , Jun Yu

Deep Neural Networks (DNNs) have shown to outperform traditional methods in various visual recognition tasks including Facial Expression Recognition (FER). In spite of efforts made to improve the accuracy of FER systems using DNN, existing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Behzad Hasani , Mohammad H. Mahoor

Facial Expression Recognition (FER) is a critical task within computer vision with diverse applications across various domains. Addressing the challenge of limited FER datasets, which hampers the generalization capability of expression…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Bach Nguyen-Xuan , Thien Nguyen-Hoang , Thanh-Huy Nguyen , Nhu Tai-Do

Facial expression recognition (FER) remains a challenging task due to the ambiguity of expressions. The derived noisy labels significantly harm the performance in real-world scenarios. To address this issue, we present a new FER model named…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Zhiyu Wu , Jinshi Cui

This paper proposes a step toward obtaining general models of knowledge for facial analysis, by addressing the question of multi-source transfer learning. More precisely, the proposed approach consists in two successive training steps: the…

Machine Learning · Computer Science 2019-11-11 Valentin Vielzeuf , Alexis Lechervy , Stéphane Pateux , Frédéric Jurie

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

Multimodal Large Language Models (MLLMs) have revolutionized numerous research fields, including computer vision and affective computing. As a pivotal challenge in this interdisciplinary domain, facial expression recognition (FER) has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Fan Zhang , Haoxuan Li , Shengju Qian , Xin Wang , Zheng Lian , Hao Wu , Zhihong Zhu , Yuan Gao , Qiankun Li , Yefeng Zheng , Zhouchen Lin , Pheng-Ann Heng

Micro-Expression Recognition has become challenging, as it is extremely difficult to extract the subtle facial changes of micro-expressions. Recently, several approaches proposed several expression-shared features algorithms for…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Ling Zhou , Qirong Mao , Xiaohua Huang , Feifei Zhang , Zhihong Zhang