English
Related papers

Related papers: Vision Transformer for Action Units Detection

200 papers

Vision transformer (ViT) has been widely applied in many areas due to its self-attention mechanism that help obtain the global receptive field since the first layer. It even achieves surprising performance exceeding CNN in some vision…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Hanting Li , Mingzhe Sui , Zhaoqing Zhu , Feng Zhao

The fifth Affective Behavior Analysis in-the-wild (ABAW) competition has multiple challenges such as Valence-Arousal Estimation Challenge, Expression Classification Challenge, Action Unit Detection Challenge, Emotional Reaction Intensity…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Darshan Gera , Badveeti Naveen Siva Kumar , Bobbili Veerendra Raj Kumar , S Balasubramanian

Human emotion recognition plays a crucial role in facilitating seamless interactions between humans and computers. In this paper, we present our innovative methodology for tackling the Valence-Arousal (VA) Estimation Challenge, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Weiwei Zhou , Chenkun Ling , Zefeng Cai

Action recognition is a crucial task in artificial intelligence, with significant implications across various domains. We initially perform a comprehensive analysis of seven prominent action recognition methods across five widely-used…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jiangning Wei , Lixiong Qin , Bo Yu , Tianjian Zou , Chuhan Yan , Dandan Xiao , Yang Yu , Lan Yang , Ke Li , Jun Liu

This article presents our results for the eighth Affective Behavior Analysis in-the-wild (ABAW) competition.Multimodal emotion recognition (ER) has important applications in affective computing and human-computer interaction. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ran Liu , Fengyu Zhang , Cong Yu , Longjiang Yang , Zhuofan Wen , Siyuan Zhang , Hailiang Yao , Shun Chen , Zheng Lian , Bin Liu

In this paper, we investigate the impact of some of the commonly used settings for (a) preprocessing face images, and (b) classification and training, on Action Unit (AU) detection performance and complexity. We use in our investigation a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Mina Bishay , Ahmed Ghoneim , Mohamed Ashraf , Mohammad Mavadati

Face Presentation Attack Detection (PAD) is an important measure to prevent spoof attacks for face biometric systems. Many works based on Convolution Neural Networks (CNNs) for face PAD formulate the problem as an image-level binary…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Zuheng Ming , Zitong Yu , Musab Al-Ghadi , Muriel Visani , Muhammad MuzzamilLuqman , Jean-Christophe Burie

Existing deep learning methods for action recognition in videos require a large number of labeled videos for training, which is labor-intensive and time-consuming. For the same action, the knowledge learned from different media types, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Yang Liu , Zhaoyang Lu , Jing Li , Tao Yang , Chao Yao

We present our contribution to the 8th ABAW challenge at CVPR 2025, where we tackle valence-arousal estimation, emotion recognition, and facial action unit detection as three independent challenges. Our approach leverages the well-known…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Josep Cabacas-Maso , Elena Ortega-Beltrán , Ismael Benito-Altamirano , Carles Ventura

Facial expression recognition(FER) in the wild is crucial for building reliable human-computer interactive systems. However, current FER systems fail to perform well under various natural and un-controlled conditions. This report presents…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Darshan Gera , S Balasubramanian

Self-attention based Transformer models have demonstrated impressive results for image classification and object detection, and more recently for video understanding. Inspired by this success, we investigate the application of Transformer…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Chenlin Zhang , Jianxin Wu , Yin Li

Facial Expression Recognition (FER) is a critical task within computer vision with diverse applications across various domains. Addressing the challenge of limited FER datasets, which hampers the generalization capability of expression…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Bach Nguyen-Xuan , Thien Nguyen-Hoang , Thanh-Huy Nguyen , Nhu Tai-Do

Nowadays, forgery faces pose pressing security concerns over fake news, fraud, impersonation, etc. Despite the demonstrated success in intra-domain face forgery detection, existing detection methods lack generalization capability and tend…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Chenqi Kong , Haoliang Li , Shiqi Wang

Pretraining Vision Transformers (ViTs) has achieved great success in visual recognition. A following scenario is to adapt a ViT to various image and video recognition tasks. The adaptation is challenging because of heavy computation and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shoufa Chen , Chongjian Ge , Zhan Tong , Jiangliu Wang , Yibing Song , Jue Wang , Ping Luo

Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Anxhelo Diko , Danilo Avola , Marco Cascio , Luigi Cinque

Human affective behavior analysis aims to delve into human expressions and behaviors to deepen our understanding of human emotions. Basic expression categories (EXPR) and Action Units (AUs) are two essential components in this analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Li Lin , Sarah Papabathini , Xin Wang , Shu Hu

The rapid advancement of generative models has led to a growing prevalence of highly realistic AI-generated images, posing significant challenges for digital forensics and content authentication. Conventional detection methods mainly rely…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Dabbrata Das , Mahshar Yahan , Md Tareq Zaman , Md Rishadul Bayesh

Holistic methods using CNNs and margin-based losses have dominated research on face recognition. In this work, we depart from this setting in two ways: (a) we employ the Vision Transformer as an architecture for training a very strong…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Zhonglin Sun , Georgios Tzimiropoulos

Face attribute evaluation plays an important role in video surveillance and face analysis. Although methods based on convolution neural networks have made great progress, they inevitably only deal with one local neighborhood with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Decheng Liu , Weijie He , Chunlei Peng , Nannan Wang , Jie Li , Xinbo Gao

This paper is a brief report to our submission to the VIPriors Action Recognition Challenge. Action recognition has attracted many researchers attention for its full application, but it is still challenging. In this paper, we study previous…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Zhipeng Luo , Dawei Xu , Zhiguang Zhang