English
Related papers

Related papers: MER-CLIP: AU-Guided Vision-Language Alignment for …

200 papers

Since Multimodal Emotion Recognition in Conversation (MERC) can be applied to public opinion monitoring, intelligent dialogue robots, and other fields, it has received extensive research attention in recent years. Unlike traditional…

Machine Learning · Computer Science 2024-07-25 Tao Meng , Fuchen Zhang , Yuntao Shou , Hongen Shao , Wei Ai , Keqin Li

Micro-gesture recognition is a challenging task in affective computing due to the subtle, involuntary nature of the gestures and their low movement amplitude. In this paper, we introduce a Pose-Guided Semantics-Aware CLIP-based…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Santosh Patapati , Trisanth Srinivasan , Amith Adiraju

The intensity estimation of facial action units (AUs) is challenging due to subtle changes in the person's facial appearance. Previous approaches mainly rely on probabilistic models or predefined rules for modeling co-occurrence…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Yingruo Fan , Jacqueline C. K. Lam , Victor O. K. Li

Detecting concealed emotions within apparently normal expressions is crucial for identifying potential mental health issues and facilitating timely support and intervention. The task of spotting macro and micro-expressions involves…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Pei-Sze Tan , Sailaja Rajanala , Arghya Pal , Raphaël C. -W. Phan , Huey-Fang Ong

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

Group-level emotion recognition (GER) aims to identify holistic emotions within a scene involving multiple individuals. Current existed methods underestimate the importance of visual scene contextual information in modeling individual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Qing Zhu , Wangdong Guo , Qirong Mao , Xiaohua Huang , Xiuyan Shao , Wenming Zheng

Emotions play a central role in the social life of every human being, and their study, which represents a multidisciplinary subject, embraces a great variety of research fields. Especially concerning the latter, the analysis of facial…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Fabio Valerio Massoli , Donato Cafarelli , Claudio Gennaro , Giuseppe Amato , Fabrizio Falchi

Detecting action units (AUs) on human faces is challenging because various AUs make subtle facial appearance change over various regions at different scales. Current works have attempted to recognize AUs by emphasizing important regions.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Chen Ma , Li Chen , Junhai Yong

Automated Facial Expression Recognition (FER) is challenging due to intra-class variations and inter-class similarities. FER can be especially difficult when facial expressions reflect a mixture of various emotions (aka compound…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Ali Pourramezan Fard , Mohammad Mehdi Hosseini , Timothy D. Sweeny , Mohammad H. Mahoor

The paper describes our proposed methodology for the six basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2022. In Learing from Synthetic Data(LSD) task, facial expression recognition (FER)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Shuyi Mao , Xinpeng Li , Junyao Chen , Xiaojiang Peng

Memes are an increasingly prevalent element of online discourse in social networks, especially among young audiences. They carry ideas and messages that range from humorous to hateful, and are widely consumed. Their potentially high impact…

How to extract effective expression representations that invariant to the identity-specific attributes is a long-lasting problem for facial expression recognition (FER). Most of the previous methods process the RGB images of a sequence,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Xiaofeng Liu , Linghao Jin , Xu Han , Jane You

MER2025 is the third year of our MER series of challenges, aiming to bring together researchers in the affective computing community to explore emerging trends and future directions in the field. Previously, MER2023 focused on multi-label…

In Video-based Facial Expression Recognition (V-FER), models are typically trained on closed-set datasets with a fixed number of known classes. However, these models struggle with unknown classes common in real-world scenarios. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yuanyuan Liu , Yuxuan Huang , Shuyang Liu , Yibing Zhan , Zijing Chen , Zhe Chen

Micro-expressions are brief spontaneous facial expressions that appear on a face when a person conceals an emotion, making them different to normal facial expressions in subtlety and duration. Currently, emotion classes within the CASME II…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Adrian K. Davison , Walied Merghani , Moi Hoon Yap

Micro-action is an imperceptible non-verbal behaviour characterised by low-intensity movement. It offers insights into the feelings and intentions of individuals and is important for human-oriented applications such as emotion recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Dan Guo , Kun Li , Bin Hu , Yan Zhang , Meng Wang

Micro-expression recognition (MER) presents a significant challenge due to the transient and subtle nature of the motion changes involved. In recent years, deep learning methods based on attention mechanisms have made some breakthroughs in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Lijun Zhang , Yifan Zhang , Weicheng Tang , Xinzhi Sun , Xiaomeng Wang , Zhanshan Li

Multimodal emotion recognition (MER) is crucial for enabling emotionally intelligent systems that perceive and respond to human emotions. However, existing methods suffer from limited cross-modal interaction and imbalanced contributions…

Multimedia · Computer Science 2025-07-30 Zeyu Deng , Yanhui Lu , Jiashu Liao , Shuang Wu , Chongfeng Wei

Dynamic facial expression recognition (DFER) aims to identify emotional states by modeling the temporal changes in facial movements across video sequences. A key challenge in DFER is the many-to-one labeling problem, where a video composed…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Gunho Jung , Heejo Kong , Seong-Whan Lee