English
Related papers

Related papers: Towards End-to-End Explainable Facial Action Unit …

200 papers

Automated deception detection systems can enhance health, justice, and security in society by helping humans detect deceivers in high-stakes situations across medical and legal domains, among others. This paper presents a novel analysis of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Leena Mathur , Maja J Matarić

The performance of deep network learning strongly depends on the choice of the non-linear activation function associated with each neuron. However, deciding on the best activation is non-trivial, and the choice depends on the architecture,…

Machine Learning · Computer Science 2020-02-05 Alejandro Molina , Patrick Schramowski , Kristian Kersting

In this paper, we present our approach to addressing the challenges of the 7th ABAW competition. The competition comprises three sub-challenges: Valence Arousal (VA) estimation, Expression (Expr) classification, and Action Unit (AU)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Kang Shen , Xuxiong Liu , Boyan Wang , Jun Yao , Xin Liu , Yujie Guan , Yu Wang , Gengchen Li , Xiao Sun

Sign Language Translation (SLT) is a challenging cross-modal task requiring joint modeling of manual articulations and non-manual signals. Existing gloss-free SLT methods effectively capture gestural dynamics but often underutilize facial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Guobin Tu , Di Weng

Reliable face forgery detection algorithms are crucial for countering the growing threat of deepfake-driven disinformation. Previous research has demonstrated the potential of Multimodal Large Language Models (MLLMs) in identifying…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Siran Peng , Zipei Wang , Li Gao , Xiangyu Zhu , Tianshuo Zhang , Ajian Liu , Haoyuan Zhang , Zhen Lei

Facial expression recognition is a challenging task due to two major problems: the presence of inter-subject variations in facial expression recognition dataset and impure expressions posed by human subjects. In this paper we present a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Kamran Ali , Ilkin Isler , Charles Hughes

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Face recognition remains vulnerable to presentation attacks, calling for robust Face Anti-Spoofing (FAS) solutions. Recent MLLM-based FAS methods reformulate the binary classification task as the generation of brief textual descriptions to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Haoyuan Zhang , Keyao Wang , Guosheng Zhang , Haixiao Yue , Zhiwen Tan , Siran Peng , Tianshuo Zhang , Xiao Tan , Kunbin Chen , Wei He , Jingdong Wang , Ajian Liu , Xiangyu Zhu , Zhen Lei

Autonomous driving has long relied on modular "Perception-Decision-Action" pipelines, where hand-crafted interfaces and rule-based components often break down in complex or long-tailed scenarios. Their cascaded design further propagates…

Video Anomaly Understanding (VAU) is essential for applications such as smart cities, security surveillance, and disaster alert systems, yet remains challenging due to its demand for fine-grained spatio-temporal perception and robust…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Liyun Zhu , Qixiang Chen , Xi Shen , Xiaodong Cun

Presentation attacks represent a critical security threat where adversaries use fake biometric data, such as face, fingerprint, or iris images, to gain unauthorized access to protected systems. Various presentation attack detection (PAD)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Rashik Shadman , M G Sarwar Murshed , Faraz Hussain

Pre-trained Vision-Language Models (VLMs) exhibit strong generalization capabilities, enabling them to recognize a wide range of objects across diverse domains without additional training. However, they often retain irrelevant information…

Machine Learning · Computer Science 2025-10-10 Kodai Kawamura , Yuta Goto , Rintaro Yanagi , Hirokatsu Kataoka , Go Irie

In this paper, we introduce an end-to-end machine learning-based system for classifying autism spectrum disorder (ASD) using facial attributes such as expressions, action units, arousal, and valence. Our system classifies ASD using…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Beibin Li , Sachin Mehta , Deepali Aneja , Claire Foster , Pamela Ventola , Frederick Shic , Linda Shapiro

Although current deep models for face tasks surpass human performance on some benchmarks, we do not understand how they work. Thus, we cannot predict how it will react to novel inputs, resulting in catastrophic failures and unwanted biases…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Thrupthi Ann John , Vineeth N Balasubramanian , C. V. Jawahar

Recognizing facial action units (AUs) during spontaneous facial displays is a challenging problem. Most recently, Convolutional Neural Networks (CNNs) have shown promise for facial AU recognition, where predefined and fixed convolution…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Shizhong Han , Zibo Meng , Zhiyuan Li , James O'Reilly , Jie Cai , Xiaofeng Wang , Yan Tong

The field of Automatic Facial Expression Analysis has grown rapidly in recent years. However, despite progress in new approaches as well as benchmarking efforts, most evaluations still focus on either posed expressions, near-frontal…

Computer Vision and Pattern Recognition · Computer Science 2017-02-15 Michel F. Valstar , Enrique Sánchez-Lozano , Jeffrey F. Cohn , László A. Jeni , Jeffrey M. Girard , Zheng Zhang , Lijun Yin , Maja Pantic

Action Units (AUs) are geometrically-based atomic facial muscle movements known to produce appearance changes at specific facial locations. Motivated by this observation we propose a novel AU modelling problem that consists of jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Ioanna Ntinou , Enrique Sanchez , Adrian Bulat , Michel Valstar , Georgios Tzimiropoulos

VILA-U is a Unified foundation model that integrates Video, Image, Language understanding and generation. Traditional visual language models (VLMs) use separate modules for understanding and generating visual content, which can lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Yecheng Wu , Zhuoyang Zhang , Junyu Chen , Haotian Tang , Dacheng Li , Yunhao Fang , Ligeng Zhu , Enze Xie , Hongxu Yin , Li Yi , Song Han , Yao Lu

Facial Expression Recognition from static images is a challenging problem in computer vision applications. Convolutional Neural Network (CNN), the state-of-the-art method for various computer vision tasks, has had limited success in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rohan Wadhawan , Tapan K. Gandhi

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

Robotics · Computer Science 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain