English
Related papers

Related papers: Automatic Facial Paralysis Estimation with Facial …

200 papers

Background: Pain assessment in individuals with neurological conditions, especially those with limited self-report ability and altered facial expressions, presents challenges. Existing measures, relying on direct observation by caregivers,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Álvaro Sabater-Gárriz , F. Xavier Gaya-Morey , José María Buades-Rubio , Cristina Manresa Yee , Pedro Montoya , Inmaculada Riquelme

In this paper, we propose to detect facial action units (AU) using 3D facial landmarks. Specifically, we train a 2D convolutional neural network (CNN) on 3D facial landmarks, tracked using a shape index-based statistical shape model, for…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Saurabh Hinduja , Shaun Canavan

This paper describes an approach to the facial action unit (AU) detection. In this work, we present our submission to the Field Affective Behavior Analysis (ABAW) 2021 competition. The proposed method uses the pre-trained JAA model as the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Chenggong Zhang , Juan Song , Qingyang Zhang , Weilong Dong , Ruomeng Ding , Zhilei Liu

Human facial action units (AUs) are mutually related in a hierarchical manner, as not only they are associated with each other in both spatial and temporal domains but also AUs located in the same/close facial regions show stronger…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zihan Wang , Siyang Song , Cheng Luo , Songhe Deng , Weicheng Xie , Linlin Shen

Central palsy is a form of facial paralysis that requires urgent medical attention and has to be differentiated from other, similar conditions such as peripheral palsy. To aid in fast and accurate diagnosis of this condition, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-01-31 C. V. Vletter , H. L. Burger , H. Alers , N. Sourlos , Z. Al-Ars

In this paper an accurate real-time sequence-based system for representation, recognition, interpretation, and analysis of the facial action units (AUs) and expressions is presented. Our system has the following characteristics: 1)…

Computer Vision and Pattern Recognition · Computer Science 2010-04-06 Mahmoud Khademi , Mohammad Hadi Kiapour , Mohammad T. Manzuri-Shalmani , Ali A. Kiaei

Most existing AU detection works considering AU relationships are relying on probabilistic graphical models with manually extracted features. This paper proposes an end-to-end deep learning framework for facial AU detection with graph…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Zhilei Liu , Jiahui Dong , Cuicui Zhang , Longbiao Wang , Jianwu Dang

Facial action unit (AU) detection remains a challenging task, due to the subtlety, dynamics, and diversity of AUs. Recently, the prevailing techniques of self-attention and causal inference have been introduced to AU detection. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zhiwen Shao , Hancheng Zhu , Yong Zhou , Xiang Xiang , Bing Liu , Rui Yao , Lizhuang Ma

Extensive efforts have been devoted to recognizing facial action units (AUs). However, it is still challenging to recognize AUs from spontaneous facial displays especially when they are accompanied with speech. Different from all prior work…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Zibo Meng , Shizhong Han , Yan Tong

The capability to perform facial analysis from video sequences has significant potential to positively impact in many areas of life. One such area relates to the medical domain to specifically aid in the diagnosis and rehabilitation of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Gary Storey , Richard Jiang , Shelagh Keogh , Ahmed Bouridane , Chang-Tsun Li

Importance: Machine learning (ML) approaches to facial landmark localization carry great clinical potential for quantitative assessment of facial function as they enable high-throughput automated quantification of relevant facial metrics…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Diego L. Guarin , Yana Yunusova , Babak Taati , Joseph R Dusseldorp , Suresh Mohan , Joana Tavares , Martinus M. van Veen , Emily Fortier , Tessa A. Hadlock , Nate Jowett

Facial action units (AUs) are essential to decode human facial expressions. Researchers have focused on training AU detectors with a variety of features and classifiers. However, several issues remain. These are spatial representation,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Wen-Sheng Chu , Fernando De la Torre , Jeffrey F. Cohn

Automatic facial action unit (AU) recognition is a challenging task due to the scarcity of manual annotations. To alleviate this problem, a large amount of efforts has been dedicated to exploiting various methods which leverage numerous…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Jingwei Yan , Jingjing Wang , Qiang Li , Chunmao Wang , Shiliang Pu

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

One-sided facial paralysis causes uneven movements of facial muscles on the sides of the face. Physicians currently assess facial asymmetry in a subjective manner based on their clinical experience. This paper proposes a novel method to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Abu Md Niamul Taufique , Andreas Savakis , Jonathan Leckenby

The key to facial expression recognition is to learn discriminative spatial-temporal representations that embed facial expression dynamics. Previous studies predominantly rely on pre-trained Convolutional Neural Networks (CNNs) to learn…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yan Li , Yong Zhao , Xiaohan Xia , Dongmei Jiang

Detecting action units (AUs) on human faces is challenging because various AUs make subtle facial appearance change over various regions at different scales. Current works have attempted to recognize AUs by emphasizing important regions.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Chen Ma , Li Chen , Junhai Yong

Facial action unit (AU) detection remains challenging because it involves heterogeneous, AU-specific uncertainties arising at both the representation and decision stages. Recent methods have improved discriminative feature learning, but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yuze Li , Zhilei Liu

Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the…

Machine Learning · Computer Science 2018-02-21 Zhanli Chen , Rashid Ansari , Diana J. Wilkie

Automatic facial action unit (AU) recognition is used widely in facial expression analysis. Most existing AU recognition systems aim for cross-participant non-calibrated generalization (NCG) to unseen faces without further calibration.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Shuangquan Feng , Virginia R. de Sa