English
Related papers

Related papers: Vision Transformer for Action Units Detection

200 papers

The recently developed Equine Facial Action Coding System (EquiFACS) provides a precise and exhaustive, but laborious, manual labelling method of facial action units of the horse. To automate parts of this process, we propose a Deep…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Zhenghong Li , Sofia Broomé , Pia Haubro Andersen , Hedvig Kjellström

This article presents our results for the eighth Affective Behavior Analysis in-the-Wild (ABAW) competition. We combine facial emotional descriptors extracted by pre-trained models, namely, our EmotiEffLib library, with acoustic features…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Andrey V. Savchenko

Facial expression in-the-wild is essential for various interactive computing domains. In this paper, we proposed an extended version of DAN model to address the VA estimation and facial expression challenges introduced in ABAW 2022. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Jae-Yeop Jeong , Yeong-Gi Hong , Daun Kim , Yuchul Jung , Jin-Woo Jeong

Extracting robust feature representation is critical for object re-identification to accurately identify objects across non-overlapping cameras. Although having a strong representation ability, the Vision Transformer (ViT) tends to overfit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Lei Tan , Pingyang Dai , Jie Chen , Liujuan Cao , Yongjian Wu , Rongrong Ji

Existing visual change detectors usually adopt CNNs or Transformers for feature representation learning and focus on learning effective representation for the changed regions between images. Although good performance can be obtained by…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Bo Jiang , Zitian Wang , Xixi Wang , Ziyan Zhang , Lan Chen , Xiao Wang , Bin Luo

While recent face anti-spoofing methods perform well under the intra-domain setups, an effective approach needs to account for much larger appearance variations of images acquired in complex scenes with different sensors for robust…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Hsin-Ping Huang , Deqing Sun , Yaojie Liu , Wen-Sheng Chu , Taihong Xiao , Jinwei Yuan , Hartwig Adam , Ming-Hsuan Yang

Face based affective computing consists in detecting emotions from face images. It is useful to unlock better automatic comprehension of human behaviours and could pave the way toward improved human-machines interactions. However it comes…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Gauthier Tallec , Jules Bonnard , Arnaud Dapogny , Kévin Bailly

The automatic intensity estimation of facial action units (AUs) from a single image plays a vital role in facial analysis systems. One big challenge for data-driven AU intensity estimation is the lack of sufficient AU label data. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Xinhui Song , Tianyang Shi , Tianjia Shao , Yi Yuan , Zunlei Feng , Changjie Fan

The activations of Facial Action Units (AUs) mutually influence one another. While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Cheng Luo , Siyang Song , Weicheng Xie , Linlin Shen , Hatice Gunes

Most of human actions consist of complex temporal compositions of more simple actions. Action recognition tasks usually relies on complex handcrafted structures as features to represent the human action model. Convolutional Neural Nets…

Computer Vision and Pattern Recognition · Computer Science 2015-12-15 Mahdyar Ravanbakhsh , Hossein Mousavi , Mohammad Rastegari , Vittorio Murino , Larry S. Davis

Biologically inspired features, such as Gabor filters, result in very high dimensional measurement. Does reducing the dimensionality of the feature space afford advantages beyond computational efficiency? Do some approaches to…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Zhuo Hui , Wen-Sheng Chu

Pose-invariant face recognition refers to the problem of identifying or verifying a person by analyzing face images captured from different poses. This problem is challenging due to the large variation of pose, illumination and facial…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 In Seop Na , Chung Tran , Dung Nguyen , Sang Dinh

Human action or activity recognition in videos is a fundamental task in computer vision with applications in surveillance and monitoring, self-driving cars, sports analytics, human-robot interaction and many more. Traditional supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Sharana Dharshikgan Suresh Dass , Hrishav Bakul Barua , Ganesh Krishnasamy , Raveendran Paramesran , Raphael C. -W. Phan

Facial Beauty Prediction (FBP) has made significant strides with the application of deep learning, yet state-of-the-art models often exhibit critical limitations, including architectural constraints, inherent demographic biases, and a lack…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Djamel Eddine Boukhari

Despite being the appearance-based classifier of choice in recent years, relatively few works have examined how much convolutional neural networks (CNNs) can improve performance on accepted expression recognition benchmarks and, more…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Pooya Khorrami , Tom Le Paine , Thomas S. Huang

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sachihiro Youoku , Takahisa Yamamoto , Junya Saito , Akiyoshi Uchida , Xiaoyu Mi , Ziqiang Shi , Liu Liu , Zhongling Liu , Osafumi Nakayama , Kentaro Murase

Recently, several Vision Transformer (ViT) based methods have been proposed for Fine-Grained Visual Classification (FGVC).These methods significantly surpass existing CNN-based ones, demonstrating the effectiveness of ViT in FGVC…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Zi-Chao Zhang , Zhen-Duo Chen , Yongxin Wang , Xin Luo , Xin-Shun Xu

Vision transformers have recently emerged as an effective alternative to convolutional networks for action recognition. However, vision transformers still struggle with geometric variations prevalent in video data. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jinhui Ye , Jiaming Zhou , Hui Xiong , Junwei Liang

The face reenactment is a popular facial animation method where the person's identity is taken from the source image and the facial motion from the driving image. Recent works have demonstrated high quality results by combining the facial…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Soumya Tripathy , Juho Kannala , Esa Rahtu

Change detection in remote sensing images is essential for tracking environmental changes on the Earth's surface. Despite the success of vision transformers (ViTs) as backbones in numerous computer vision applications, they remain…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Duowang Zhu , Xiaohu Huang , Haiyan Huang , Zhenfeng Shao , Qimin Cheng