English
Related papers

Related papers: Self-Supervised Regional and Temporal Auxiliary Ta…

200 papers

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

This paper describes an approach to the facial action unit (AU) detection. In this work, we present our submission to the Field Affective Behavior Analysis (ABAW) 2021 competition. The proposed method uses the pre-trained JAA model as the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Chenggong Zhang , Juan Song , Qingyang Zhang , Weilong Dong , Ruomeng Ding , Zhilei Liu

The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression analysis. Many methods that perform well on automatic facial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xuri Ge , Joemon M. Jose , Songpei Xu , Xiao Liu , Hu Han

The automatic intensity estimation of facial action units (AUs) from a single image plays a vital role in facial analysis systems. One big challenge for data-driven AU intensity estimation is the lack of sufficient AU label data. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Xinhui Song , Tianyang Shi , Tianjia Shao , Yi Yuan , Zunlei Feng , Changjie Fan

In this work, we benchmark with different backbones and study their impact for self-supervised learning (SSL) as an auxiliary task to blend texture-based local descriptors into feature modelling for efficient face analysis. It is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shukesh Reddy , Abhijit Das

Recognizing human emotion/expressions automatically is quite an expected ability for intelligent robotics, as it can promote better communication and cooperation with humans. Current deep-learning-based algorithms may achieve impressive…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Tao Pu , Tianshui Chen , Yuan Xie , Hefeng Wu , Liang Lin

The domain diversities including inconsistent annotation and varied image collection conditions inevitably exist among different facial expression recognition (FER) datasets, which pose an evident challenge for adapting the FER model…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Kai Wang , Yuxin Gu , Xiaojiang Peng , Panpan Zhang , Baigui Sun , Hao Li

Facial action unit (AU) detection in the wild is a challenging problem, due to the unconstrained variability in facial appearances and the lack of accurate annotations. Most existing methods depend on either impractical labor-intensive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Zhiwen Shao , Jianfei Cai , Tat-Jen Cham , Xuequan Lu , Lizhuang Ma

Facial action unit (AU) recognition is essential to facial expression analysis. Since there are highly positive or negative correlations between AUs, some existing AU recognition works have focused on modeling AU relations. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Yao Wei , Haoxiang Wang , Mingze Sun , Jiawang Liu

Facial Action Unit (AU) detection has gained significant attention as it enables the breakdown of complex facial expressions into individual muscle movements. In this paper, we revisit two fundamental factors in AU detection: diverse and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Mang Ning , Albert Ali Salah , Itir Onal Ertugrul

Facial action unit (AU) recognition is a crucial task for facial expressions analysis and has attracted extensive attention in the field of artificial intelligence and computer vision. Existing works have either focused on designing or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Guanbin Li , Xin Zhu , Yirui Zeng , Qing Wang , Liang Lin

Unsupervised video representation learning has made remarkable achievements in recent years. However, most existing methods are designed and optimized for video classification. These pre-trained models can be sub-optimal for temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Can Zhang , Tianyu Yang , Junwu Weng , Meng Cao , Jue Wang , Yuexian Zou

Action Units (AUs) are geometrically-based atomic facial muscle movements known to produce appearance changes at specific facial locations. Motivated by this observation we propose a novel AU modelling problem that consists of jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Ioanna Ntinou , Enrique Sanchez , Adrian Bulat , Michel Valstar , Georgios Tzimiropoulos

In this work, we explore Self-supervised Learning (SSL) as an auxiliary task to blend the texture-based local descriptors into feature modelling for efficient face analysis. Combining a primary task and a self-supervised auxiliary task is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Shukesh Reddy , Nishit Poddar , Srijan Das , Abhijit Das

High-quality annotated images are significant to deep facial expression recognition (FER) methods. However, uncertain labels, mostly existing in large-scale public datasets, often mislead the training process. In this paper, we achieve…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Yang Liu , Xingming Zhang , Janne Kauttonen , Guoying Zhao

Facial Action Units (AUs) are essential for conveying psychological states and emotional expressions. While automatic AU detection systems leveraging deep learning have progressed, they often overfit to specific datasets and individual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yong Li , Yi Ren , Xuesong Niu , Yi Ding , Xiu-Shen Wei , Cuntai Guan

The Facial Action Coding System (FACS) for studying facial expressions is manual and requires significant effort and expertise. This paper explores the use of automated techniques to generate Action Units (AUs) for studying facial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Shivansh Chandra Tripathi , Rahul Garg

Facial action unit (AU) detection is a fundamental block for objective facial expression analysis. Supervised learning approaches require a large amount of manual labeling which is costly. The limited labeled data are also not diverse in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Liupei Lu , Yufeng Yin , Yuming Gu , Yizhen Wu , Pratusha Prasad , Yajie Zhao , Mohammad Soleymani

Temporal Action Localization (TAL) has garnered significant attention in information retrieval. Existing supervised or weakly supervised methods heavily rely on labeled temporal boundaries and action categories, which are labor-intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Rui Xia , Dan Jiang , Quan Zhang , Ke Zhang , Chun Yuan

Deep learning methods typically depend on the availability of labeled data, which is expensive and time-consuming to obtain. Active learning addresses such effort by prioritizing which samples are best to annotate in order to maximize the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert