English
Related papers

Related papers: A Transfer Learning approach to Heatmap Regression…

200 papers

Automatic detection of facial Action Units (AUs) allows for objective facial expression analysis. Due to the high cost of AU labeling and the limited size of existing benchmarks, previous AU detection methods tend to overfit the dataset,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yufeng Yin , Di Chang , Guoxian Song , Shen Sang , Tiancheng Zhi , Jing Liu , Linjie Luo , Mohammad Soleymani

In this paper, we present a process to investigate the effects of transfer learning for automatic facial expression recognition from emotions to pain. To this end, we first train a VGG16 convolutional neural network to automatically discern…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Pooja Prajod , Dominik Schiller , Tobias Huber , Elisabeth André

Facial Action Units detection (FAUs) represents a fine-grained classification problem that involves identifying different units on the human face, as defined by the Facial Action Coding System. In this paper, we present a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tu Vu , Van Thong Huynh , Soo Hyung Kim

The face expression is the first thing we pay attention to when we want to understand a person's state of mind. Thus, the ability to recognize facial expressions in an automatic way is a very interesting research field. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Enrico Randellini , Leonardo Rigutini , Claudio Sacca'

Micro-Expression Recognition (MER) is a challenging task as the subtle changes occur over different action regions of a face. Changes in facial action regions are formed as Action Units (AUs), and AUs in micro-expressions can be seen as the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ling Zhou , Qirong Mao , Ming Dong

For the Facial Action Unit (AU) detection task, accurately capturing the subtle facial differences between distinct AUs is essential for reliable detection. Additionally, AU detection faces challenges from class imbalance and the presence…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Ziqiao Shang , Bin Liu , Fengmao Lv , Fei Teng , Tianrui Li , Lan-Zhe Guo

As a fine-grained and local expression behavior measurement, facial action unit (FAU) analysis (e.g., detection and intensity estimation) has been documented for its time-consuming, labor-intensive, and error-prone annotation. Thus a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bowen Ma , Rudong An , Wei Zhang , Yu Ding , Zeng Zhao , Rongsheng Zhang , Tangjie Lv , Changjie Fan , Zhipeng Hu

This paper describes an approach to the facial action unit (AU) detection. In this work, we present our submission to the Field Affective Behavior Analysis (ABAW) 2021 competition. The proposed method uses the pre-trained JAA model as the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Chenggong Zhang , Juan Song , Qingyang Zhang , Weilong Dong , Ruomeng Ding , Zhilei Liu

In facial action unit (AU) recognition tasks, regional feature learning and AU relation modeling are two effective aspects which are worth exploring. However, the limited representation capacity of regional features makes it difficult for…

Computer Vision and Pattern Recognition · Computer Science 2021-02-25 Jingwei Yan , Boyuan Jiang , Jingjing Wang , Qiang Li , Chunmao Wang , Shiliang Pu

Dense Associative Memory (DenseAM) is a promising family of AI architectures that is represented by a neural network performing temporal dynamics on an energy landscape. While hyperparameter transfer methods are well-studied for…

Machine Learning · Computer Science 2026-05-12 Roi Holtzman , Dmitry Krotov , Boris Hanin

In this paper, we propose a computational efficient end-to-end training deep neural network (CEDNN) model and spatial attention maps based on difference images. Firstly, the difference image is generated by image processing. Then five…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Jing Chen , Chenhui Wang , Kejun Wang , Meichen Liu

Action Units (AU) are muscular activations used to describe facial expressions. Therefore accurate AU recognition unlocks unbiaised face representation which can improve face-based affective computing applications. From a learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Gauthier Tallec , Arnaud Dapogny , Kevin Bailly

Facial action unit (AU) detection and facial expression (FE) recognition can be jointly viewed as affective facial behavior tasks, representing fine-grained muscular activations and coarse-grained holistic affective states, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jia Li , Yu Zhang , Yin Chen , Zhenzhen Hu , Yong Li , Richang Hong , Shiguang Shan , Meng Wang

This paper presents our Facial Action Units (AUs) detection submission to the fifth Affective Behavior Analysis in-the-wild Competition (ABAW). Our approach consists of three main modules: (i) a pre-trained facial representation encoder…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Zihan Wang , Siyang Song , Cheng Luo , Yuzhi Zhou , Shiling Wu , Weicheng Xie , Linlin Shen

Machine learning models automatically learn discriminative features from the data, and are therefore susceptible to learn strongly-correlated biases, such as using protected attributes like gender and race. Most existing bias mitigation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Varsha Suresh , Desmond C. Ong

Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the…

Machine Learning · Computer Science 2018-02-21 Zhanli Chen , Rashid Ansari , Diana J. Wilkie

Over the course of the last decade, infrared (IR) and particularly thermal IR imaging based face recognition has emerged as a promising complement to conventional, visible spectrum based approaches which continue to struggle when applied in…

Computer Vision and Pattern Recognition · Computer Science 2013-06-11 Reza Shoja Ghiass , Ognjen Arandjelovic , Hakim Bendada , Xavier Maldague

Although current face alignment algorithms have obtained pretty good performances at predicting the location of facial landmarks, huge challenges remain for faces with severe occlusion and large pose variations, etc. On the contrary,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Jinheng Xie , Jun Wan , Linlin Shen , Zhihui Lai

Face image animation from a single image has achieved remarkable progress. However, it remains challenging when only sparse landmarks are available as the driving signal. Given a source face image and a sequence of sparse face landmarks,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Ruiqi Zhao , Tianyi Wu , Guodong Guo

Heatmap regression with a deep network has become one of the mainstream approaches to localize facial landmarks. However, the loss function for heatmap regression is rarely studied. In this paper, we analyze the ideal loss function…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Xinyao Wang , Liefeng Bo , Li Fuxin