English
Related papers

Related papers: Meta-Auxiliary Learning for Micro-Expression Recog…

200 papers

Micro-expression recognition (MER) is crucial in the affective computing field due to its wide application in medical diagnosis, lie detection, and criminal investigation. Despite its significance, obtaining micro-expression (ME)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jiateng Liu , Hengcan Shi , Feng Chen , Zhiwen Shao , Yaonan Wang , Jianfei Cai , Wenming Zheng

Micro-expressions are hard to spot due to fleeting and involuntary moments of facial muscles. Interpretation of micro emotions from video clips is a challenging task. In this paper we propose an affective-motion imaging that cumulates rapid…

Multimedia · Computer Science 2021-04-16 Monu Verma , Santosh Kumar Vipparthi , Girdhari Singh

Micro-expressions, characterized by transience and subtlety, pose challenges to existing optical flow-based recognition methods. To address this, this paper proposes a dual-branch micro-expression feature extraction network integrated with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Mingjie Zhang , Bo Li , Wanting Liu , Hongyan Cui , Yue Li , Qingwen Li , Hong Li , Ge Gao

Micro expression recognition (MER) is a very challenging area of research due to its intrinsic nature and fine-grained changes. In the literature, the problem of MER has been solved through handcrafted/descriptor-based techniques. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Monu Verma , Santosh Kumar Vipparthi , Girdhari Singh

Micro-expression recognition (MER) presents a significant challenge due to the transient and subtle nature of the motion changes involved. In recent years, deep learning methods based on attention mechanisms have made some breakthroughs in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Lijun Zhang , Yifan Zhang , Weicheng Tang , Xinzhi Sun , Xiaomeng Wang , Zhanshan Li

Micro-expression recognition (MER) is a highly challenging task in affective computing. With the reduced-sized micro-expression (ME) input that contains key information based on key-frame indexes, key-frame-based methods have significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zheyuan Zhang , Weihao Tang , Hong Chen

Micro-expressions (MEs) are involuntary, low-intensity, and short-duration facial expressions that often reveal an individual's genuine thoughts and emotions. Most existing ME analysis methods rely on window-level classification with fixed…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Zizheng Guo , Bochao Zou , Yinuo Jia , Xiangyu Li , Huimin Ma

Micro-Expression (ME) is the spontaneous, involuntary movement of a face that can reveal the true feeling. Recently, increasing researches have paid attention to this field combing deep learning techniques. Action units (AUs) are the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Ling Lo , Hong-Xia Xie , Hong-Han Shuai , Wen-Huang Cheng

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

Human-Computer Interaction · Computer Science 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Micro-expressions (MEs) are spontaneous, unconscious facial expressions that have promising applications in various fields such as psychotherapy and national security. Thus, micro-expression recognition (MER) has attracted more and more…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ruolin Li , Lu Wang , Tingting Yang , Lisheng Xu , Bingyang Ma , Yongchun Li , Hongchao Wei

Micro-Expression Recognition (MER) is a challenging task as the subtle changes occur over different action regions of a face. Changes in facial action regions are formed as Action Units (AUs), and AUs in micro-expressions can be seen as the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ling Zhou , Qirong Mao , Ming Dong

The lack of data and the difficulty of multimodal fusion have always been challenges for multimodal emotion recognition (MER). In this paper, we propose to use pretrained models as upstream network, wav2vec 2.0 for audio modality and BERT…

Computation and Language · Computer Science 2023-02-28 Dekai Sun , Yancheng He , Jiqing Han

Micro-expression (ME) recognition plays a crucial role in a wide range of applications, particularly in public security and psychotherapy. Recently, traditional methods rely excessively on machine learning design and the recognition rate is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Jinming Liu , Ke Li , Baolin Song , Li Zhao

Micro-expression recognition is one of the most challenging topics in affective computing. It aims to recognize tiny facial movements difficult for humans to perceive in a brief period, i.e., 0.25 to 0.5 seconds. Recent advances in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Xuan-Bac Nguyen , Chi Nhan Duong , Xin Li , Susan Gauch , Han-Seok Seo , Khoa Luu

As a critical psychological stress response, micro-expressions (MEs) are fleeting and subtle facial movements revealing genuine emotions. Automatic ME recognition (MER) holds valuable applications in fields such as criminal investigation…

Human-Computer Interaction · Computer Science 2025-05-12 Shifeng Liu , Xinglong Mao , Sirui Zhao , Peiming Li , Tong Xu , Enhong Chen

Facial micro-expression recognition (MER) is a challenging task, due to the transience, subtlety, and dynamics of micro-expressions (MEs). Most existing methods resort to hand-crafted features or deep networks, in which the former often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Zhiwen Shao , Yifan Cheng , Fan Zhang , Xuehuai Shi , Canlin Li , Lizhuang Ma , Dit-yan Yeung

In this paper, we propose MMER, a novel Multimodal Multi-task learning approach for Speech Emotion Recognition. MMER leverages a novel multimodal network based on early-fusion and cross-modal self-attention between text and acoustic…

Computation and Language · Computer Science 2023-06-06 Sreyan Ghosh , Utkarsh Tyagi , S Ramaneswaran , Harshvardhan Srivastava , Dinesh Manocha

Micro-expressions (MEs), brief and low-intensity facial movements revealing concealed emotions, are crucial for affective computing. Despite notable progress in ME recognition, existing methods are largely confined to discrete emotion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Sirui Zhao , Zhengye Zhang , Shifeng Liu , Xinglong Mao , Shukang Yin , Chaoyou Fu , Tong Xu , Enhong Chen

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (e.g., facial expression, speech) or implicitly (e.g., text, image). Enabling machines to have emotional…

Signal Processing · Electrical Eng. & Systems 2021-11-10 Sicheng Zhao , Guoli Jia , Jufeng Yang , Guiguang Ding , Kurt Keutzer

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…