English
Related papers

Related papers: AU-Aware Vision Transformers for Biased Facial Exp…

200 papers

Facial expression recognition (FER) has received increasing interest in computer vision. We propose the TransFER model which can learn rich relation-aware local representations. It mainly consists of three components: Multi-Attention…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Fanglei Xue , Qiangchang Wang , Guodong Guo

The increasing amount of applications of Artificial Intelligence (AI) has led researchers to study the social impact of these technologies and evaluate their fairness. Unfortunately, current fairness metrics are hard to apply in multi-class…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar

Facial Expression Recognition (FER) uses images of faces to identify the emotional state of users, allowing for a closer interaction between humans and autonomous systems. Unfortunately, as the images naturally integrate some demographic…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar

Facial action unit (AU) detection in the wild is a challenging problem, due to the unconstrained variability in facial appearances and the lack of accurate annotations. Most existing methods depend on either impractical labor-intensive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Zhiwen Shao , Jianfei Cai , Tat-Jen Cham , Xuequan Lu , Lizhuang Ma

Capsule neural network is a new and popular technique in deep learning. However, the traditional capsule neural network does not extract features sufficiently before the dynamic routing between the capsules. In this paper, the one Double…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Shan Cao , Yuqian Yao , Gaoyun An

Automatically understanding emotions from visual data is a fundamental task for human behaviour understanding. While models devised for Facial Expression Recognition (FER) have demonstrated excellent performances on many datasets, they…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Alessandro Conti , Paolo Rota , Yiming Wang , Elisa Ricci

Facial expression recognition (FER) models are typically trained on datasets with a fixed number of seven basic classes. However, recent research works point out that there are far more expressions than the basic ones. Thus, when these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yuhang Zhang , Yue Yao , Xuannan Liu , Lixiong Qin , Wenjing Wang , Weihong Deng

Facial expression plays an important role in understanding human emotions. Most recently, deep learning based methods have shown promising for facial expression recognition. However, the performance of the current state-of-the-art facial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Ping Liu , Yunchao Wei , Zibo Meng , Weihong Deng , Joey Tianyi Zhou , Yi Yang

Automatically recognizing emotional intent using facial expression has been a thoroughly investigated topic in the realm of computer vision. Facial Expression Recognition (FER), being a supervised learning task, relies heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Syed Sameen Ahmad Rizvi , Aryan Seth , Pratik Narang

Detecting facial action units (AU) is one of the fundamental steps in automatic recognition of facial expression of emotions and cognitive states. Though there have been a variety of approaches proposed for this task, most of these models…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Mihee Lee , Ognjen Rudovic , Vladimir Pavlovic , Maja Pantic

In recent years, deep learning has achieved innovative advancements in various fields, including the analysis of human emotions and behaviors. Initiatives such as the Affective Behavior Analysis in-the-wild (ABAW) competition have been…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Seongjae Min , Junseok Yang , Sangjun Lim , Junyong Lee , Sangwon Lee , Sejoon Lim

Facial action unit (AU) detection is challenging due to the difficulty in capturing correlated information from subtle and dynamic AUs. Existing methods often resort to the localization of correlated regions of AUs, in which predefining…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Zhiwen Shao , Yong Zhou , Jianfei Cai , Hancheng Zhu , Rui Yao

Current Facial Action Unit (FAU) detection methods generally encounter difficulties due to the scarcity of labeled video training data and the limited number of training face IDs, which renders the trained feature extractor insufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Qiaoqiao Jin , Rui Shi , Yishun Dou , Bingbing Ni

Occlusion and pose variations, which can change facial appearance significantly, are two major obstacles for automatic Facial Expression Recognition (FER). Though automatic FER has made substantial progresses in the past few decades,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Kai Wang , Xiaojiang Peng , Jianfei Yang , Debin Meng , Yu Qiao

Facial expressions and actions differ among different individuals at varying degrees of intensity given responses to external stimuli, particularly among those that are neurodivergent. Such behaviors affect people in terms of overall…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Manuel Serna-Aguilera , Xuan Bac Nguyen , Han-Seok Seo , Khoa Luu

Existing methods for driver facial expression recognition (DFER) are often computationally intensive, rendering them unsuitable for real-time applications. In this work, we introduce a novel transfer learning-based dual architecture, named…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Ibtissam Saadi , Douglas W. Cunningham , Taleb-ahmed Abdelmalik , Abdenour Hadid , Yassin El Hillali

Nowadays, visual data forgery detection plays an increasingly important role in social and economic security with the rapid development of generative models. Existing face forgery detectors still can't achieve satisfactory performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yuhan Luo , Tao Chen , Decheng Liu

Facial expression recognition (FER) is a challenging topic in artificial intelligence. Recently, many researchers have attempted to introduce Vision Transformer (ViT) to the FER task. However, ViT cannot fully utilize emotional features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yu Zhou , Liyuan Guo , Lianghai Jin

Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the…

Machine Learning · Computer Science 2018-02-21 Zhanli Chen , Rashid Ansari , Diana J. Wilkie

It is challenging to recognize facial action unit (AU) from spontaneous facial displays, especially when they are accompanied by speech. The major reason is that the information is extracted from a single source, i.e., the visual channel,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-03 Zibo Meng , Shizhong Han , Ping Liu , Yan Tong