English
Related papers

Related papers: Action Unit Detection with Joint Adaptive Attentio…

200 papers

Action Unit (AU) Detection is the branch of affective computing that aims at recognizing unitary facial muscular movements. It is key to unlock unbiased computational face representations and has therefore aroused great interest in the past…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Gauthier Tallec , Edouard Yvinec , Arnaud Dapogny , Kevin Bailly

Facial action units (AUs) detection is fundamental to facial expression analysis. As AU occurs only in a small area of the face, region-based learning has been widely recognized useful for AU detection. Most region-based studies focus on a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Yao Xia

Facial expressions are combinations of basic components called Action Units (AU). Recognizing AUs is key for developing general facial expression analysis. In recent years, most efforts in automatic AU recognition have been dedicated to…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Ciprian A. Corneanu , Meysam Madadi , Sergio Escalera

In this paper, we present our solution and experiment result for the Multi-Task Learning Challenge of the 7th Affective Behavior Analysis in-the-wild(ABAW7) Competition. This challenge consists of three tasks: action unit detection, facial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xiaodong Li , Wenchao Du , Hongyu Yang

Facial action unit (AU) detection is a challenging task due to the scarcity of manual annotations. Recent works on AU detection with self-supervised learning have emerged to address this problem, aiming to learn meaningful AU…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Juan Song , Zhilei Liu

Due to its importance in facial behaviour analysis, facial action unit (AU) detection has attracted increasing attention from the research community. Leveraging the online knowledge distillation framework, we propose the ``FANTrans" method…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Jing Yang , Jie Shen , Yiming Lin , Yordan Hristov , Maja Pantic

The detection of facial action units (AUs) has been studied as it has the competition due to the wide-ranging applications thereof. In this paper, we propose a novel framework for the AU detection from a single input image by grasping the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Ziqiang Shi , Liu Liu , Zhongling Liu , Rujie Liu , Xiaoyu Mi , and Kentaro Murase

In this paper, we propose to detect facial action units (AU) using 3D facial landmarks. Specifically, we train a 2D convolutional neural network (CNN) on 3D facial landmarks, tracked using a shape index-based statistical shape model, for…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Saurabh Hinduja , Shaun Canavan

Facial Action Unit (AU) detection is a crucial task for emotion analysis from facial movements. The apparent differences of different subjects sometimes mislead changes brought by AUs, resulting in inaccurate results. However, most of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jiyuan Cao , Zhilei Liu , Yong Zhang

Expressions and facial action units (AUs) are two levels of facial behavior descriptors. Expression auxiliary information has been widely used to improve the AU detection performance. However, most existing expression representations can…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Rudong An , Wei Zhang , Hao Zeng , Wei Chen , Zhigang Deng , Yu Ding

Since Facial Action Unit (AU) annotations require domain expertise, common AU datasets only contain a limited number of subjects. As a result, a crucial challenge for AU detection is addressing identity overfitting. We find that AUs and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Zhipeng Hu , Wei Zhang , Lincheng Li , Yu Ding , Wei Chen , Zhigang Deng , Xin Yu

Affective Behavior Analysis aims to develop emotionally intelligent technology that can recognize and respond to human emotions. To advance this field, the 7th Affective Behavior Analysis in-the-wild (ABAW) competition holds the Multi-Task…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Chen Liu , Wei Zhang , Feng Qiu , Lincheng Li , Xin Yu

As a fine-grained and local expression behavior measurement, facial action unit (FAU) analysis (e.g., detection and intensity estimation) has been documented for its time-consuming, labor-intensive, and error-prone annotation. Thus a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bowen Ma , Rudong An , Wei Zhang , Yu Ding , Zeng Zhao , Rongsheng Zhang , Tangjie Lv , Changjie Fan , Zhipeng Hu

Automatic detection of facial Action Units (AUs) allows for objective facial expression analysis. Due to the high cost of AU labeling and the limited size of existing benchmarks, previous AU detection methods tend to overfit the dataset,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yufeng Yin , Di Chang , Guoxian Song , Shen Sang , Tiancheng Zhi , Jing Liu , Linjie Luo , Mohammad Soleymani

Facial Action Unit (AU) detection seeks to recognize subtle facial muscle activations as defined by the Facial Action Coding System (FACS). A primary challenge w.r.t AU detection is the effective learning of discriminative and generalizable…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yong Li , Yi Ren , Yizhe Zhang , Wenhua Zhang , Tianyi Zhang , Muyun Jiang , Guo-Sen Xie , Cuntai Guan

Facial Action Unit (AU) detection is a crucial task in affective computing and social robotics as it helps to identify emotions expressed through facial expressions. Anatomically, there are innumerable correlations between AUs, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Xin Liu , Kaishen Yuan , Xuesong Niu , Jingang Shi , Zitong Yu , Huanjing Yue , Jingyu Yang

Most existing AU detection works considering AU relationships are relying on probabilistic graphical models with manually extracted features. This paper proposes an end-to-end deep learning framework for facial AU detection with graph…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Zhilei Liu , Jiahui Dong , Cuicui Zhang , Longbiao Wang , Jianwu Dang

The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression analysis. Many methods that perform well on automatic facial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xuri Ge , Joemon M. Jose , Songpei Xu , Xiao Liu , Hu Han

The muscular activities caused the activation of certain AUs for every facial expression at the certain duration of time throughout the facial expression. This paper presents the methods to recognise facial Action Unit (AU) using facial…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 N. Hussain , H. Ujir , I. Hipiny , J-L Minoi

Facial action unit (AU) recognition is essential to facial expression analysis. Since there are highly positive or negative correlations between AUs, some existing AU recognition works have focused on modeling AU relations. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Yao Wei , Haoxiang Wang , Mingze Sun , Jiawang Liu