English
Related papers

Related papers: AU-Supervised Convolutional Vision Transformers fo…

200 papers

Dynamic facial expression recognition (DFER) in the wild is still hindered by data limitations, e.g., insufficient quantity and diversity of pose, occlusion and illumination, as well as the inherent ambiguity of facial expressions. In…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yin Chen , Jia Li , Shiguang Shan , Meng Wang , Richang Hong

Facial expression recognition (FER) is a critical task in multimedia with significant implications across various domains. However, analyzing the causes of facial expressions is essential for accurately recognizing them. Current approaches,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xing Lan , Jian Xue , Ji Qi , Dongmei Jiang , Ke Lu , Tat-Seng Chua

Understanding the facial expressions of our interlocutor is important to enrich the communication and to give it a depth that goes beyond the explicitly expressed. In fact, studying one's facial expression gives insight into their hidden…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Rim EL Cheikh , Hélène Tran , Issam Falih , Engelbert Mephu Nguifo

Facial Action Units (AUs) are of great significance in the realm of affective computing. In this paper, we propose AU-LLaVA, the first unified AU recognition framework based on the Large Language Model (LLM). AU-LLaVA consists of a visual…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Guohong Hu , Xing Lan , Hanyu Jiang , Jiayi Lyu , Jian Xue

Semi-supervised learning has emerged as a promising approach to tackle the challenge of label scarcity in facial expression recognition (FER) task. However, current state-of-the-art methods primarily focus on one side of the coin, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Fan Zhang , Zhi-Qi Cheng , Jian Zhao , Xiaojiang Peng , Xuelong Li

Over the centuries, humans have developed and acquired a number of ways to communicate. But hardly any of them can be as natural and instinctive as facial expressions. On the other hand, neural networks have taken the world by storm. And no…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Subodh Lonkar

The recent success of Transformer has provided a new direction to various visual understanding tasks, including video-based facial expression recognition (FER). By modeling visual relations effectively, Transformer has shown its power for…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Yuanyuan Liu , Wenbin Wang , Chuanxu Feng , Haoyu Zhang , Zhe Chen , Yibing Zhan

Facial expression recognition has been an active research area over the past few decades, and it is still challenging due to the high intra-class variation. Traditional approaches for this problem rely on hand-crafted features such as SIFT,…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Shervin Minaee , Amirali Abdolrashidi

In recent years, deep learning has achieved innovative advancements in various fields, including the analysis of human emotions and behaviors. Initiatives such as the Affective Behavior Analysis in-the-wild (ABAW) competition have been…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Seongjae Min , Junseok Yang , Sangjun Lim , Junyong Lee , Sangwon Lee , Sejoon Lim

Human emotion recognition holds a pivotal role in facilitating seamless human-computer interaction. This paper delineates our methodology in tackling the Valence-Arousal (VA) Estimation Challenge, Expression (Expr) Classification Challenge,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Weiwei Zhou , Jiada Lu , Chenkun Ling , Weifeng Wang , Shaowei Liu

Facial expression recognition is a challenging task due to two major problems: the presence of inter-subject variations in facial expression recognition dataset and impure expressions posed by human subjects. In this paper we present a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Kamran Ali , Ilkin Isler , Charles Hughes

Representation learning and feature disentanglement have garnered significant research interest in the field of facial expression recognition (FER). The inherent ambiguity of emotion labels poses challenges for conventional supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Jia Li , Jiantao Nie , Dan Guo , Richang Hong , Meng Wang

The field of Automatic Facial Expression Analysis has grown rapidly in recent years. However, despite progress in new approaches as well as benchmarking efforts, most evaluations still focus on either posed expressions, near-frontal…

Computer Vision and Pattern Recognition · Computer Science 2017-02-15 Michel F. Valstar , Enrique Sánchez-Lozano , Jeffrey F. Cohn , László A. Jeni , Jeffrey M. Girard , Zheng Zhang , Lijun Yin , Maja Pantic

The Facial Action Coding System (FACS) has been used by numerous studies to investigate the links between facial behavior and mental health. The laborious and costly process of FACS coding has motivated the development of machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Evangelos Sariyanidi , Lisa Yankowitz , Robert T. Schultz , John D. Herrington , Birkan Tunc , Jeffrey Cohn

Facial expressions play a fundamental role in human communication. Indeed, they typically reveal the real emotional status of people beyond the spoken language. Moreover, the comprehension of human affect based on visual patterns is a key…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Fabio Valerio Massoli , Donato Cafarelli , Giuseppe Amato , Fabrizio Falchi

Analyzing human affect is vital for human-computer interaction systems. Most methods are developed in restricted scenarios which are not practical for in-the-wild settings. The Affective Behavior Analysis in-the-wild (ABAW) 2021 Contest…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Yue Jin , Tianqing Zheng , Chao Gao , Guoqiang Xu

The ever-increasing demands for intuitive interactions in Virtual Reality has triggered a boom in the realm of Facial Expression Recognition (FER). To address the limitations in existing approaches (e.g., narrow receptive fields and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yande Li , Mingjie Wang , Minglun Gong , Yonggang Lu , Li Liu

Facial Action Units (AUs) detection is a cornerstone of objective facial expression analysis and a critical focus in affective computing. Despite its importance, AU detection faces significant challenges, such as the high cost of AU…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Bohao Xing , Kaishen Yuan , Zitong Yu , Xin Liu , Heikki Kälviäinen

Existing methods for driver facial expression recognition (DFER) are often computationally intensive, rendering them unsuitable for real-time applications. In this work, we introduce a novel transfer learning-based dual architecture, named…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Ibtissam Saadi , Douglas W. Cunningham , Taleb-ahmed Abdelmalik , Abdenour Hadid , Yassin El Hillali

Facial action units (AUs), as defined in the Facial Action Coding System (FACS), have received significant research interest owing to their diverse range of applications in facial state analysis. Current mainstream FAU recognition models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xuri Ge , Junchen Fu , Fuhai Chen , Shan An , Nicu Sebe , Joemon M. Jose