English
Related papers

Related papers: Action Units Recognition Using Improved Pairwise D…

200 papers

As a fine-grained and local expression behavior measurement, facial action unit (FAU) analysis (e.g., detection and intensity estimation) has been documented for its time-consuming, labor-intensive, and error-prone annotation. Thus a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bowen Ma , Rudong An , Wei Zhang , Yu Ding , Zeng Zhao , Rongsheng Zhang , Tangjie Lv , Changjie Fan , Zhipeng Hu

Human facial action units (AUs) are mutually related in a hierarchical manner, as not only they are associated with each other in both spatial and temporal domains but also AUs located in the same/close facial regions show stronger…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zihan Wang , Siyang Song , Cheng Luo , Songhe Deng , Weicheng Xie , Linlin Shen

Facial action unit (AU) detection is challenging due to the difficulty in capturing correlated information from subtle and dynamic AUs. Existing methods often resort to the localization of correlated regions of AUs, in which predefining…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Zhiwen Shao , Yong Zhou , Jianfei Cai , Hancheng Zhu , Rui Yao

Human affective behavior analysis plays a vital role in human-computer interaction (HCI) systems. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). We propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun Yu , Renda Li , Zhongpeng Cai , Gongpeng Zhao , Guochen Xie , Jichao Zhu , Wangyuan Zhu

People naturally understand emotions, thus permitting a machine to do the same could open new paths for human-computer interaction. Facial expressions can be very useful for emotion recognition techniques, as these are the biggest…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Pietro B. S. Masur , Willams Costa , Lucas S. Figueredo , Veronica Teichrieb

This paper presents a subject-independent facial action unit (AU) detection method by introducing the concept of relative AU detection, for scenarios where the neutral face is not provided. We propose a new classification objective function…

Computer Vision and Pattern Recognition · Computer Science 2014-05-02 Mahmoud Khademi , Louis-Philippe Morency

Facial action units (AUs) detection is fundamental to facial expression analysis. As AU occurs only in a small area of the face, region-based learning has been widely recognized useful for AU detection. Most region-based studies focus on a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Yao Xia

In this report, we present our solution for the Action Unit (AU) Detection Challenge, in 8th Competition on Affective Behavior Analysis in-the-wild. In order to achieve robust and accurate classification of facial action unit in the wild…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jun Yu , Yunxiang Zhang , Xilong Lu , Yang Zheng , Yongqi Wang , Lingsi Zhu

The activations of Facial Action Units (AUs) mutually influence one another. While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Cheng Luo , Siyang Song , Weicheng Xie , Linlin Shen , Hatice Gunes

Facial action unit (AU) detection remains a challenging task, due to the subtlety, dynamics, and diversity of AUs. Recently, the prevailing techniques of self-attention and causal inference have been introduced to AU detection. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zhiwen Shao , Hancheng Zhu , Yong Zhou , Xiang Xiang , Bing Liu , Rui Yao , Lizhuang Ma

Dynamic Facial Expression Recognition(DFER) is a rapidly evolving field of research that focuses on the recognition of time-series facial expressions. While previous research on DFER has concentrated on feature learning from a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Feng Liu , Lingna Gu , Chen Shi , Xiaolan Fu

Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the…

Machine Learning · Computer Science 2018-02-21 Zhanli Chen , Rashid Ansari , Diana J. Wilkie

In this paper, we propose to detect facial action units (AU) using 3D facial landmarks. Specifically, we train a 2D convolutional neural network (CNN) on 3D facial landmarks, tracked using a shape index-based statistical shape model, for…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Saurabh Hinduja , Shaun Canavan

It is challenging to recognize facial action unit (AU) from spontaneous facial displays, especially when they are accompanied by speech. The major reason is that the information is extracted from a single source, i.e., the visual channel,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-03 Zibo Meng , Shizhong Han , Ping Liu , Yan Tong

Detecting action units is an important task in face analysis, especially in facial expression recognition. This is due, in part, to the idea that expressions can be decomposed into multiple action units. In this paper we investigate the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Saurabh Hinduja , Shaun Canavan , Saandeep Aathreya

Facial behavior analysis is a broad topic with various categories such as facial emotion recognition, age, and gender recognition. Many studies focus on individual tasks while the multi-task learning approach is still an open research issue…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Dang-Khanh Nguyen , Sudarshan Pant , Ngoc-Huynh Ho , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

The detection of facial action units (AUs) has been studied as it has the competition due to the wide-ranging applications thereof. In this paper, we propose a novel framework for the AU detection from a single input image by grasping the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Ziqiang Shi , Liu Liu , Zhongling Liu , Rujie Liu , Xiaoyu Mi , and Kentaro Murase

Facial Action Units (AUs) are of great significance in the realm of affective computing. In this paper, we propose AU-LLaVA, the first unified AU recognition framework based on the Large Language Model (LLM). AU-LLaVA consists of a visual…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Guohong Hu , Xing Lan , Hanyu Jiang , Jiayi Lyu , Jian Xue

Facial action units (AUs) recognition is essential for emotion analysis and has been widely applied in mental state analysis. Existing work on AU recognition usually requires big face dataset with AU labels; however, manual AU annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Xuesong Niu , Hu Han , Shiguang Shan , Xilin Chen

Recognizing human emotion/expressions automatically is quite an expected ability for intelligent robotics, as it can promote better communication and cooperation with humans. Current deep-learning-based algorithms may achieve impressive…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Tao Pu , Tianshui Chen , Yuan Xie , Hefeng Wu , Liang Lin