English
Related papers

Related papers: Towards Unified Facial Action Unit Recognition Fra…

200 papers

This paper presents a subject-independent facial action unit (AU) detection method by introducing the concept of relative AU detection, for scenarios where the neutral face is not provided. We propose a new classification objective function…

Computer Vision and Pattern Recognition · Computer Science 2014-05-02 Mahmoud Khademi , Louis-Philippe Morency

Human affective behavior analysis plays a vital role in human-computer interaction (HCI) systems. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). We propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun Yu , Renda Li , Zhongpeng Cai , Gongpeng Zhao , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Recently how to introduce large amounts of unlabeled facial images in the wild into supervised Facial Action Unit (AU) detection frameworks has become a challenging problem. In this paper, we propose a new AU detection framework where…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ziqiao Shang , Li Yu

Dynamic Facial Expression Recognition(DFER) is a rapidly evolving field of research that focuses on the recognition of time-series facial expressions. While previous research on DFER has concentrated on feature learning from a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Feng Liu , Lingna Gu , Chen Shi , Xiaolan Fu

The Facial Action Coding System (FACS) for studying facial expressions is manual and requires significant effort and expertise. This paper explores the use of automated techniques to generate Action Units (AUs) for studying facial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Shivansh Chandra Tripathi , Rahul Garg

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in various tasks. However, effectively evaluating these MLLMs on face perception remains largely unexplored. To address this gap, we introduce FaceBench, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Xiaoqin Wang , Xusen Ma , Xianxu Hou , Meidan Ding , Yudong Li , Junliang Chen , Wenting Chen , Xiaoyang Peng , Linlin Shen

The paper describes our proposed methodology for the six basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2022. In Learing from Synthetic Data(LSD) task, facial expression recognition (FER)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Shuyi Mao , Xinpeng Li , Junyao Chen , Xiaojiang Peng

Current Facial Action Unit (FAU) detection methods generally encounter difficulties due to the scarcity of labeled video training data and the limited number of training face IDs, which renders the trained feature extractor insufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Qiaoqiao Jin , Rui Shi , Yishun Dou , Bingbing Ni

Facial expression recognition (FER) is an important research topic in emotional artificial intelligence. In recent decades, researchers have made remarkable progress. However, current FER paradigms face challenges in generalization, lack…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Bohao Xing , Zitong Yu , Xin Liu , Kaishen Yuan , Qilang Ye , Weicheng Xie , Huanjing Yue , Jingyu Yang , Heikki Kälviäinen

The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression analysis. Many methods that perform well on automatic facial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xuri Ge , Joemon M. Jose , Songpei Xu , Xiao Liu , Hu Han

Recently, large multimodal models (LMMs) have achieved significant advancements. When dealing with high-resolution images, dominant LMMs typically divide them into multiple local images and a global image, leading to a large number of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zhibin Lan , Liqiang Niu , Fandong Meng , Wenbo Li , Jie Zhou , Jinsong Su

Facial Action Units detection (FAUs) represents a fine-grained classification problem that involves identifying different units on the human face, as defined by the Facial Action Coding System. In this paper, we present a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tu Vu , Van Thong Huynh , Soo Hyung Kim

Facial action units (AUs) recognition is essential for emotion analysis and has been widely applied in mental state analysis. Existing work on AU recognition usually requires big face dataset with AU labels; however, manual AU annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Xuesong Niu , Hu Han , Shiguang Shan , Xilin Chen

Current works formulate facial action unit (AU) recognition as a supervised learning problem, requiring fully AU-labeled facial images during training. It is challenging if not impossible to provide AU annotations for large numbers of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Shangfei Wang , Yanan Chang , Guozhu Peng , Bowen Pan

Large Language Models (LLMs) have shown great promise in automating data analytics tasks by interpreting natural language queries and generating multi-operation execution plans. However, existing LLM-agent-based analytics frameworks operate…

Artificial Intelligence · Computer Science 2025-11-03 Haichao Ji , Zibo Wang , Cheng Pan , Meng Han , Yifei Zhu , Dan Wang , Zhu Han

The previous advancements in pathology image understanding primarily involved developing models tailored to specific tasks. Recent studies has demonstrated that the large vision-language model can enhance the performance of various…

Artificial Intelligence · Computer Science 2024-08-20 Dawei Dai , Yuanhui Zhang , Long Xu , Qianlan Yang , Xiaojing Shen , Shuyin Xia , Guoyin Wang

Facial action unit (AU) detection is challenging due to the difficulty in capturing correlated information from subtle and dynamic AUs. Existing methods often resort to the localization of correlated regions of AUs, in which predefining…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Zhiwen Shao , Yong Zhou , Jianfei Cai , Hancheng Zhu , Rui Yao

Human facial action units (AUs) are mutually related in a hierarchical manner, as not only they are associated with each other in both spatial and temporal domains but also AUs located in the same/close facial regions show stronger…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zihan Wang , Siyang Song , Cheng Luo , Songhe Deng , Weicheng Xie , Linlin Shen

The rapid advancement of Large Language Models (LLMs) has marked a significant breakthrough in Artificial Intelligence (AI), ushering in a new era of Human-centered Artificial Intelligence (HAI). HAI aims to better serve human welfare and…

Robotics · Computer Science 2025-10-29 Wenbin Ding , Jun Chen , Mingjia Chen , Fei Xie , Qi Mao , Philip Dames

The activations of Facial Action Units (AUs) mutually influence one another. While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Cheng Luo , Siyang Song , Weicheng Xie , Linlin Shen , Hatice Gunes