English
Related papers

Related papers: Modeling Spatial and Temporal Cues for Multi-label…

200 papers

Facial action unit (AU) detection, aiming to classify AU present in the facial image, has long suffered from insufficient AU annotations. In this paper, we aim to mitigate this data scarcity issue by learning AU representations from a large…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Yong Li , Shiguang Shan

In this paper an accurate real-time sequence-based system for representation, recognition, interpretation, and analysis of the facial action units (AUs) and expressions is presented. Our system has the following characteristics: 1)…

Computer Vision and Pattern Recognition · Computer Science 2010-04-06 Mahmoud Khademi , Mohammad Hadi Kiapour , Mohammad T. Manzuri-Shalmani , Ali A. Kiaei

Facial Action Units (AUs) detection is a cornerstone of objective facial expression analysis and a critical focus in affective computing. Despite its importance, AU detection faces significant challenges, such as the high cost of AU…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Bohao Xing , Kaishen Yuan , Zitong Yu , Xin Liu , Heikki Kälviäinen

The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression analysis. Many methods that perform well on automatic facial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xuri Ge , Joemon M. Jose , Songpei Xu , Xiao Liu , Hu Han

Facial action units (AUs) recognition is essential for emotion analysis and has been widely applied in mental state analysis. Existing work on AU recognition usually requires big face dataset with AU labels; however, manual AU annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Xuesong Niu , Hu Han , Shiguang Shan , Xilin Chen

Facial expressions are one of the most powerful ways for depicting specific patterns in human behavior and describing human emotional state. Despite the impressive advances of affective computing over the last decade, automatic video-based…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Thomas Teixeira , Eric Granger , Alessandro Lameiras Koerich

Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep learning framework that integrates useful clues from…

Multimedia · Computer Science 2017-06-15 Yu-Gang Jiang , Zuxuan Wu , Jinhui Tang , Zechao Li , Xiangyang Xue , Shih-Fu Chang

Facial Action Unit (AU) detection is a crucial task for emotion analysis from facial movements. The apparent differences of different subjects sometimes mislead changes brought by AUs, resulting in inaccurate results. However, most of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jiyuan Cao , Zhilei Liu , Yong Zhang

Spatio-temporal information is very important to capture the discriminative cues between genuine and fake faces from video sequences. To explore such a temporal feature, the fine-grained motions (e.g., eye blinking, mouth movements and head…

Computer Vision and Pattern Recognition · Computer Science 2019-01-18 Xiaoguang Tu , Hengsheng Zhang , Mei Xie , Yao Luo , Yuefei Zhang , Zheng Ma

Facial action units (AUs), as defined in the Facial Action Coding System (FACS), have received significant research interest owing to their diverse range of applications in facial state analysis. Current mainstream FAU recognition models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xuri Ge , Junchen Fu , Fuhai Chen , Shan An , Nicu Sebe , Joemon M. Jose

Facial action unit (AU) detection is challenging due to the difficulty in capturing correlated information from subtle and dynamic AUs. Existing methods often resort to the localization of correlated regions of AUs, in which predefining…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Zhiwen Shao , Yong Zhou , Jianfei Cai , Hancheng Zhu , Rui Yao

Since Facial Action Unit (AU) annotations require domain expertise, common AU datasets only contain a limited number of subjects. As a result, a crucial challenge for AU detection is addressing identity overfitting. We find that AUs and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Zhipeng Hu , Wei Zhang , Lincheng Li , Yu Ding , Wei Chen , Zhigang Deng , Xin Yu

In this paper we address the problem of human action recognition from video sequences. Inspired by the exemplary results obtained via automatic feature learning and deep learning approaches in computer vision, we focus our attention towards…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Harshala Gammulle , Simon Denman , Sridha Sridharan , Clinton Fookes

Despite being the appearance-based classifier of choice in recent years, relatively few works have examined how much convolutional neural networks (CNNs) can improve performance on accepted expression recognition benchmarks and, more…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Pooya Khorrami , Tom Le Paine , Thomas S. Huang

Automatic facial action unit (AU) recognition is a challenging task due to the scarcity of manual annotations. To alleviate this problem, a large amount of efforts has been dedicated to exploiting various methods which leverage numerous…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Jingwei Yan , Jingjing Wang , Qiang Li , Chunmao Wang , Shiliang Pu

Detecting facial action units (AU) is one of the fundamental steps in automatic recognition of facial expression of emotions and cognitive states. Though there have been a variety of approaches proposed for this task, most of these models…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Mihee Lee , Ognjen Rudovic , Vladimir Pavlovic , Maja Pantic

Facial Action Unit (AU) detection is a crucial task in affective computing and social robotics as it helps to identify emotions expressed through facial expressions. Anatomically, there are innumerable correlations between AUs, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Xin Liu , Kaishen Yuan , Xuesong Niu , Jingang Shi , Zitong Yu , Huanjing Yue , Jingyu Yang

Affective Computing has recently attracted the attention of the research community, due to its numerous applications in diverse areas. In this context, the emergence of video-based data allows to enrich the widely used spatial features with…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Decky Aspandi , Federico Sukno , Björn Schuller , Xavier Binefa

Current Facial Action Unit (FAU) detection methods generally encounter difficulties due to the scarcity of labeled video training data and the limited number of training face IDs, which renders the trained feature extractor insufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Qiaoqiao Jin , Rui Shi , Yishun Dou , Bingbing Ni

Facial action units (AUs) detection is fundamental to facial expression analysis. As AU occurs only in a small area of the face, region-based learning has been widely recognized useful for AU detection. Most region-based studies focus on a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Yao Xia