English
Related papers

Related papers: Micron-BERT: BERT-based Facial Micro-Expression Re…

200 papers

Micro-expression recognition (MER) presents a significant challenge due to the transient and subtle nature of the motion changes involved. In recent years, deep learning methods based on attention mechanisms have made some breakthroughs in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Lijun Zhang , Yifan Zhang , Weicheng Tang , Xinzhi Sun , Xiaomeng Wang , Zhanshan Li

Spotting facial micro-expression from videos finds various potential applications in fields including clinical diagnosis and interrogation, meanwhile this task is still difficult due to the limited scale of training data. To solve this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Yi Zhang , Youjun Zhao , Yuhang Wen , Zixuan Tang , Xinhua Xu , Mengyuan Liu

Introducing BERT into cross-modal settings raises difficulties in its optimization for handling multiple modalities. Both the BERT architecture and training objective need to be adapted to incorporate and model information from different…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xin Li , Peng Li , Zeyong Wei , Zhe Zhu , Mingqiang Wei , Junhui Hou , Liangliang Nan , Jing Qin , Haoran Xie , Fu Lee Wang

Micro expression recognition (MER) is crucial for inferring genuine emotion. Applying a multimodal large language model (MLLM) to this task enables spatio-temporal analysis of facial motion and provides interpretable descriptions. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Ren Zhang , Huilai Li , Chao qi , Guoliang Xu , Tianyu Zhou , Wei wei , Jianqin Yin

Micro-action is an imperceptible non-verbal behaviour characterised by low-intensity movement. It offers insights into the feelings and intentions of individuals and is important for human-oriented applications such as emotion recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Dan Guo , Kun Li , Bin Hu , Yan Zhang , Meng Wang

Facial expression is related to facial muscle contractions and different muscle movements correspond to different emotional states. For micro-expression recognition, the muscle movements are usually subtle, which has a negative impact on…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Zhifeng Wang , Kaihao Zhang , Wenhan Luo , Ramesh Sankaranarayana

As a critical psychological stress response, micro-expressions (MEs) are fleeting and subtle facial movements revealing genuine emotions. Automatic ME recognition (MER) holds valuable applications in fields such as criminal investigation…

Human-Computer Interaction · Computer Science 2025-05-12 Shifeng Liu , Xinglong Mao , Sirui Zhao , Peiming Li , Tong Xu , Enhong Chen

Multi-modal pretraining for learning high-level multi-modal representation is a further step towards deep learning and artificial intelligence. In this work, we propose a novel model, namely InterBERT (BERT for Interaction), which is the…

Computation and Language · Computer Science 2021-04-23 Junyang Lin , An Yang , Yichang Zhang , Jie Liu , Jingren Zhou , Hongxia Yang

Micro-expressions are brief spontaneous facial expressions that appear on a face when a person conceals an emotion, making them different to normal facial expressions in subtlety and duration. Currently, emotion classes within the CASME II…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Adrian K. Davison , Walied Merghani , Moi Hoon Yap

Facial expression recognition (FER) aims to analyze emotional states from static images and dynamic sequences, which is pivotal in enhancing anthropomorphic communication among humans, robots, and digital avatars by leveraging AI…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Yan Wang , Shaoqi Yan , Yang Liu , Wei Song , Jing Liu , Yang Chang , Xinji Mai , Xiping Hu , Wenqiang Zhang , Zhongxue Gan

Facial expression has a significant role in analyzing human cognitive state. Deriving an accurate facial appearance representation is a critical task for an automatic facial expression recognition application. This paper provides a new…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Monu Verma , Prafulla Saxena , Santosh. K. Vipparthi , Gridhari Singh

Emotion Recognition (ER) is the process of identifying human emotions from given data. Currently, the field heavily relies on facial expression recognition (FER) because facial expressions contain rich emotional cues. However, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuanyuan Liu , Lin Wei , Kejun Liu , Yibing Zhan , Zijing Chen , Zhe Chen , Shiguang Shan

Facial expression recognition (FER) has always been a challenging issue in computer vision. The different expressions of emotion and uncontrolled environmental factors lead to inconsistencies in the complexity of FER and variability of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Tianyuan Chang , Guihua Wen , Yang Hu , JiaJiong Ma

Micro-expressions are short bursts of emotion that are difficult to hide. Their detection in children is an important cue to assist psychotherapists in conducting better therapy. However, existing research on the detection of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Nikin~Matharaarachchi , Muhammad~Fermi Pasha , Sonya~Coleman , Kah PengWong

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen

Micro-Expression Recognition has become challenging, as it is extremely difficult to extract the subtle facial changes of micro-expressions. Recently, several approaches proposed several expression-shared features algorithms for…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Ling Zhou , Qirong Mao , Xiaohua Huang , Feifei Zhang , Zhihong Zhang

Prompt learning has been widely adopted to efficiently adapt vision-language models (VLMs) like CLIP for various downstream tasks. Despite their success, current VLM-based facial expression recognition (FER) methods struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Fuyan Ma , Yiran He , Bin Sun , Shutao Li

Deep facial expression recognition faces two challenges that both stem from the large number of trainable parameters: long training times and a lack of interpretability. We propose a novel method based on evolutionary algorithms, that deals…

Neural and Evolutionary Computing · Computer Science 2020-10-14 Emmanuel Dufourq , Bruce A. Bassett

Facial expression recognition (FER) has received increasing interest in computer vision. We propose the TransFER model which can learn rich relation-aware local representations. It mainly consists of three components: Multi-Attention…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Fanglei Xue , Qiangchang Wang , Guodong Guo

Micro-expressions are spontaneous, unconscious facial movements that show people's true inner emotions and have great potential in related fields of psychological testing. Since the face is a 3D deformation object, the occurrence of an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Fengping Wang , Jie Li , Siqi Zhang , Chun Qi , Yun Zhang , Danmin Miao