English
Related papers

Related papers: FG-Net: Facial Action Unit Detection with Generali…

200 papers

Facial Action Unit (AU) detection has gained significant attention as it enables the breakdown of complex facial expressions into individual muscle movements. In this paper, we revisit two fundamental factors in AU detection: diverse and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Mang Ning , Albert Ali Salah , Itir Onal Ertugrul

Current Facial Action Unit (FAU) detection methods generally encounter difficulties due to the scarcity of labeled video training data and the limited number of training face IDs, which renders the trained feature extractor insufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Qiaoqiao Jin , Rui Shi , Yishun Dou , Bingbing Ni

Detecting action units (AUs) on human faces is challenging because various AUs make subtle facial appearance change over various regions at different scales. Current works have attempted to recognize AUs by emphasizing important regions.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Chen Ma , Li Chen , Junhai Yong

Facial action units (AUs) are essential to decode human facial expressions. Researchers have focused on training AU detectors with a variety of features and classifiers. However, several issues remain. These are spatial representation,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Wen-Sheng Chu , Fernando De la Torre , Jeffrey F. Cohn

Detecting facial action units (AU) is one of the fundamental steps in automatic recognition of facial expression of emotions and cognitive states. Though there have been a variety of approaches proposed for this task, most of these models…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Mihee Lee , Ognjen Rudovic , Vladimir Pavlovic , Maja Pantic

This paper presents a subject-independent facial action unit (AU) detection method by introducing the concept of relative AU detection, for scenarios where the neutral face is not provided. We propose a new classification objective function…

Computer Vision and Pattern Recognition · Computer Science 2014-05-02 Mahmoud Khademi , Louis-Philippe Morency

Facial Action Units (AUs) represent a set of facial muscular activities and various combinations of AUs can represent a wide range of emotions. AU recognition is often used in many applications, including marketing, healthcare, education,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Junya Saito , Xiaoyu Mi , Akiyoshi Uchida , Sachihiro Youoku , Takahisa Yamamoto , Kentaro Murase , Osafumi Nakayama

Facial action unit detection has emerged as an important task within facial expression analysis, aimed at detecting specific pre-defined, objective facial expressions, such as lip tightening and cheek raising. This paper presents our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yufeng Yin , Minh Tran , Di Chang , Xinrui Wang , Mohammad Soleymani

Facial Action Coding System consists of 44 action units (AUs) and more than 7000 combinations. Hidden Markov models (HMMs) classifier has been used successfully to recognize facial action units (AUs) and expressions due to its ability to…

Computer Vision and Pattern Recognition · Computer Science 2010-04-06 Mahmoud Khademi , Mohammad T. Manzuri-Shalmani , Mohammad H. Kiapour , Ali A. Kiaei

The face reenactment is a popular facial animation method where the person's identity is taken from the source image and the facial motion from the driving image. Recent works have demonstrated high quality results by combining the facial…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Soumya Tripathy , Juho Kannala , Esa Rahtu

The Facial Action Coding System (FACS) has been used by numerous studies to investigate the links between facial behavior and mental health. The laborious and costly process of FACS coding has motivated the development of machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Evangelos Sariyanidi , Lisa Yankowitz , Robert T. Schultz , John D. Herrington , Birkan Tunc , Jeffrey Cohn

The detection of facial action units (AUs) has been studied as it has the competition due to the wide-ranging applications thereof. In this paper, we propose a novel framework for the AU detection from a single input image by grasping the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Ziqiang Shi , Liu Liu , Zhongling Liu , Rujie Liu , Xiaoyu Mi , and Kentaro Murase

We propose a novel convolutional neural network approach to address the fine-grained recognition problem of multi-view dynamic facial action unit detection. We leverage recent gains in large-scale object recognition by formulating the task…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Andres Romero , Juan Leon , Pablo Arbelaez

Multimodal foundation models have significantly improved feature representation by integrating information from multiple modalities, making them highly suitable for a broader set of applications. However, the exploration of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kaiwen Zheng , Xuri Ge , Junchen Fu , Jun Peng , Joemon M. Jose

Facial action unit recognition has many applications from market research to psychotherapy and from image captioning to entertainment. Despite its recent progress, deployment of these models has been impeded due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Javier Hernandez , Daniel McDuff , Ognjen , Rudovic , Alberto Fung , Mary Czerwinski

It is challenging to recognize facial action unit (AU) from spontaneous facial displays, especially when they are accompanied by speech. The major reason is that the information is extracted from a single source, i.e., the visual channel,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-03 Zibo Meng , Shizhong Han , Ping Liu , Yan Tong

Facial action unit (AU) detection remains a challenging task, due to the subtlety, dynamics, and diversity of AUs. Recently, the prevailing techniques of self-attention and causal inference have been introduced to AU detection. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zhiwen Shao , Hancheng Zhu , Yong Zhou , Xiang Xiang , Bing Liu , Rui Yao , Lizhuang Ma

As a fine-grained and local expression behavior measurement, facial action unit (FAU) analysis (e.g., detection and intensity estimation) has been documented for its time-consuming, labor-intensive, and error-prone annotation. Thus a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bowen Ma , Rudong An , Wei Zhang , Yu Ding , Zeng Zhao , Rongsheng Zhang , Tangjie Lv , Changjie Fan , Zhipeng Hu

Automatic facial behavior analysis has a long history of studies in the intersection of computer vision, physiology and psychology. However it is only recently, with the collection of large-scale datasets and powerful machine learning…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Facial Action Coding System is an approach for modeling the complexity of human emotional expression. Automatic action unit (AU) detection is a crucial research area in human-computer interaction. This paper describes our submission to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Duy Le Hoai , Eunchae Lim , Eunbin Choi , Sieun Kim , Sudarshan Pant , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang