English
Related papers

Related papers: DFME: A New Benchmark for Dynamic Facial Micro-exp…

200 papers

The study of Dynamic Facial Expression Recognition (DFER) is a nascent field of research that involves the automated recognition of facial expressions in video data. Although existing research has primarily focused on learning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Feng Liu , Hanyang Wang , Siyuan Shen

Effective human-AI interaction relies on AI's ability to accurately perceive and interpret human emotions. Current benchmarks for vision and vision-language models are severely limited, offering a narrow emotional spectrum that overlooks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Christoph Schuhmann , Robert Kaczmarczyk , Gollam Rabby , Felix Friedrich , Maurice Kraus , Krishna Kalyan , Kourosh Nadi , Huu Nguyen , Kristian Kersting , Sören Auer

Dynamic Facial Expression Recognition(DFER) is a rapidly evolving field of research that focuses on the recognition of time-series facial expressions. While previous research on DFER has concentrated on feature learning from a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Feng Liu , Lingna Gu , Chen Shi , Xiaolan Fu

Compared with the image-based static facial expression recognition (SFER) task, the dynamic facial expression recognition (DFER) task based on video sequences is closer to the natural expression recognition scene. However, DFER is often…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Hanting Li , Hongjing Niu , Zhaoqing Zhu , Feng Zhao

In many domains, including online education, healthcare, security, and human-computer interaction, facial emotion recognition (FER) is essential. Real-world FER is still difficult despite its significance because of some factors such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Deeptimaan Banerjee , Prateek Gothwal , Ashis Kumer Biswas

This paper presents MMA-MRNNet, a novel deep learning architecture for dynamic multi-output Facial Expression Intensity Estimation (FEIE) from video data. Traditional approaches to this task often rely on complex 3-D CNNs, which require…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Dimitrios Kollias , Andreas Psaroudakis , Anastasios Arsenos , Paraskevi Theofilou , Chunchang Shao , Guanyu Hu , Ioannis Patras

Deception detection has garnered increasing attention in recent years due to the significant growth of digital media and heightened ethical and security concerns. It has been extensively studied using multimodal methods, including video,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Cong Cai , Shan Liang , Xuefei Liu , Kang Zhu , Zhengqi Wen , Jianhua Tao , Heng Xie , Jizhou Cui , Yiming Ma , Zhenhua Cheng , Hanzhe Xu , Ruibo Fu , Bin Liu , Yongwei Li

One of the most universal ways that people communicate is through facial expressions. In this paper, we take a deep dive, implementing multiple deep learning models for facial expression recognition (FER). Our goals are twofold: we aim not…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Amil Khanzada , Charles Bai , Ferhat Turker Celepcikay

Micro-expression recognition is vital for affective computing but remains challenging due to the extremely brief, low-intensity facial motions involved and the high-dimensional nature of 4D mesh data. To address these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Luu Tu Nguyen , Thi Bich Phuong Man , Vu Tram Anh Khuong , Thanh Ha Le , Thi Duyen Ngo

Micro expression recognition (MER) is crucial for inferring genuine emotion. Applying a multimodal large language model (MLLM) to this task enables spatio-temporal analysis of facial motion and provides interpretable descriptions. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Ren Zhang , Huilai Li , Chao qi , Guoliang Xu , Tianyu Zhou , Wei wei , Jianqin Yin

With the transition of facial expression recognition (FER) from laboratory-controlled to challenging in-the-wild conditions and the recent success of deep learning techniques in various fields, deep neural networks have increasingly been…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Shan Li , Weihong Deng

Dynamic facial expression recognition (DFER) in the wild is still hindered by data limitations, e.g., insufficient quantity and diversity of pose, occlusion and illumination, as well as the inherent ambiguity of facial expressions. In…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yin Chen , Jia Li , Shiguang Shan , Meng Wang , Richang Hong

Correctly perceiving micro-expression is difficult since micro-expression is an involuntary, repressed, and subtle facial expression, and efficiently revealing the subtle movement changes and capturing the significant segments in a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Jiateng Liu , Wenming Zheng , Yuan Zong

Accurate emotion recognition is pivotal for nuanced and engaging human-computer interactions, yet remains difficult to achieve, especially in dynamic, conversation-like settings. In this study, we showcase how integrating eye-tracking data,…

Human-Computer Interaction · Computer Science 2025-11-03 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Barrett , Paolo Burelli

Micro-action is an imperceptible non-verbal behaviour characterised by low-intensity movement. It offers insights into the feelings and intentions of individuals and is important for human-oriented applications such as emotion recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Dan Guo , Kun Li , Bin Hu , Yan Zhang , Meng Wang

Micro-expressions (MEs) are regarded as important indicators of an individual's intrinsic emotions, preferences, and tendencies. ME analysis requires spotting of ME intervals within long video sequences and recognition of their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zizheng Guo , Bochao Zou , Junbao Zhuo , Huimin Ma

How to extract effective expression representations that invariant to the identity-specific attributes is a long-lasting problem for facial expression recognition (FER). Most of the previous methods process the RGB images of a sequence,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Xiaofeng Liu , Linghao Jin , Xu Han , Jane You

Facial expression is one of the most external indications of a person's feelings and emotions. In daily conversation, according to the psychologist, only 7% and 38% of information is communicated through words and sounds respective, while…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Mengyu Rao , Ruyi Bao , Liangshun Dong

Automatic Emotion Detection (ED) aims to build systems to identify users' emotions automatically. This field has the potential to enhance HCI, creating an individualised experience for the user. However, ED systems tend to perform poorly on…

Human-Computer Interaction · Computer Science 2023-07-27 Annanda Sousa , Karen Young , Mathieu D'aquin , Manel Zarrouk , Jennifer Holloway

The development of existing facial coding systems, such as the Facial Action Coding System (FACS), relied on manual examination of facial expression videos for defining Action Units (AUs). To overcome the labor-intensive nature of this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Shivansh Chandra Tripathi , Rahul Garg