English
Related papers

Related papers: EmoCLIP: A Vision-Language Method for Zero-Shot Vi…

200 papers

Understanding human affective behaviour, especially in the dynamics of real-world settings, requires Facial Expression Recognition (FER) models to continuously adapt to individual differences in user expression, contextual attributions, and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Nikhil Churamani , Tolga Dimlioglu , German I. Parisi , Hatice Gunes

Facial expression recognition (FER) is an important research topic in emotional artificial intelligence. In recent decades, researchers have made remarkable progress. However, current FER paradigms face challenges in generalization, lack…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Bohao Xing , Zitong Yu , Xin Liu , Kaishen Yuan , Qilang Ye , Weicheng Xie , Huanjing Yue , Jingyu Yang , Heikki Kälviäinen

Vision-Language Models (VLMs) like CLIP offer promising solutions for Dynamic Facial Expression Recognition (DFER) but face challenges such as inefficient full fine-tuning, high complexity, and poor alignment between textual and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ibtissam Saadi , Abdenour Hadid , Douglas W. Cunningham , Abdelmalik Taleb-Ahmed , Yassin El Hillali

Facial expression recognition (FER) in 3D and 4D domains presents a significant challenge in affective computing due to the complexity of spatial and temporal facial dynamics. Its success is crucial for advancing applications in human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Muzammil Behzad

Face Emotion Recognition (FER) is essential for social interactions and understanding others' mental states. Utilizing eye tracking to investigate FER has yielded insights into cognitive processes. In this study, we utilized an…

Human-Computer Interaction · Computer Science 2025-03-21 Meisam J. Seikavandi , Maria J. Barrett , Paolo Burelli

Emotion Recognition (ER) is the process of identifying human emotions from given data. Currently, the field heavily relies on facial expression recognition (FER) because facial expressions contain rich emotional cues. However, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuanyuan Liu , Lin Wei , Kejun Liu , Yibing Zhan , Zijing Chen , Zhe Chen , Shiguang Shan

Vision-language models like CLIP are widely used in zero-shot image classification due to their ability to understand various visual concepts and natural language descriptions. However, how to fully leverage CLIP's unprecedented human-like…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Bang An , Sicheng Zhu , Michael-Andrei Panaitescu-Liess , Chaithanya Kumar Mummadi , Furong Huang

Facial Expression Recognition(FER) is one of the most important topic in Human-Computer interactions(HCI). In this work we report details and experimental results about a facial expression recognition method based on state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Donato Cafarelli , Fabio Valerio Massoli , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

This study investigates the key characteristics and suitability of widely used Facial Expression Recognition (FER) datasets for training deep learning models. In the field of affective computing, FER is essential for interpreting human…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 F. Xavier Gaya-Morey , Cristina Manresa-Yee , Célia Martinie , Jose M. Buades-Rubio

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen

Representation learning and feature disentanglement have garnered significant research interest in the field of facial expression recognition (FER). The inherent ambiguity of emotion labels poses challenges for conventional supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Jia Li , Jiantao Nie , Dan Guo , Richang Hong , Meng Wang

In this paper, we present our solution for the Second Multimodal Emotion Recognition Challenge Track 1(MER2024-SEMI). To enhance the accuracy and generalization performance of emotion recognition, we propose several methods for Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Anbin QI , Zhongliang Liu , Xinyong Zhou , Jinba Xiao , Fengrun Zhang , Qi Gan , Ming Tao , Gaozheng Zhang , Lu Zhang

Emotion Recognition in Conversation (ERC) is essential for effective human-machine interaction, aiming to identify speakers' emotional states in multi-turn dialogues. Early text-based methods struggle with complex scenarios like sarcasm…

Artificial Intelligence · Computer Science 2026-05-19 Linan ZHU , Zihao Zhai , Xiao Han , Yuqian Fu , Xiangfan Chen , Xiangjie Kong , Guojiang Shen

Facial expressions are the most common universal forms of body language. In the past few years, automatic facial expression recognition (FER) has been an active field of research. However, it is still a challenging task due to different…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Rauf Momin , Ali Shan Momin , Khalid Rasheed , Muhammad Saqib

Recent advancements in large-scale pre-training of visual-language models on paired image-text data have demonstrated impressive generalization capabilities for zero-shot tasks. Building on this success, efforts have been made to adapt…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Shahzad Ahmad , Sukalpa Chanda , Yogesh S Rawat

The performance of CLIP in dynamic facial expression recognition (DFER) task doesn't yield exceptional results as observed in other CLIP-based classification tasks. While CLIP's primary objective is to achieve alignment between images and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Zeng Tao , Yan Wang , Junxiong Lin , Haoran Wang , Xinji Mai , Jiawen Yu , Xuan Tong , Ziheng Zhou , Shaoqi Yan , Qing Zhao , Liyuan Han , Wenqiang Zhang

Human affective behavior analysis aims to delve into human expressions and behaviors to deepen our understanding of human emotions. Basic expression categories (EXPR) and Action Units (AUs) are two essential components in this analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Li Lin , Sarah Papabathini , Xin Wang , Shu Hu

Automated Facial Expression Recognition (FER) is challenging due to intra-class variations and inter-class similarities. FER can be especially difficult when facial expressions reflect a mixture of various emotions (aka compound…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Ali Pourramezan Fard , Mohammad Mehdi Hosseini , Timothy D. Sweeny , Mohammad H. Mahoor

Current benchmarks for facial expression recognition (FER) mainly focus on static images, while there are limited datasets for FER in videos. It is still ambiguous to evaluate whether performances of existing methods remain satisfactory in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yan Wang , Yixuan Sun , Yiwen Huang , Zhongying Liu , Shuyong Gao , Wei Zhang , Weifeng Ge , Wenqiang Zhang

Understanding the facial expressions of our interlocutor is important to enrich the communication and to give it a depth that goes beyond the explicitly expressed. In fact, studying one's facial expression gives insight into their hidden…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Rim EL Cheikh , Hélène Tran , Issam Falih , Engelbert Mephu Nguifo