English
Related papers

Related papers: TAG: Thinking with Action Unit Grounding for Facia…

200 papers

Facial expression recognition (FER) has emerged as a promising approach to the development of emotion-aware intelligent agents and systems. However, key challenges remain in utilizing FER in real-world contexts, including ensuring user…

Human-Computer Interaction · Computer Science 2025-07-31 Sanjeev Nahulanthran , Leimin Tian , Dana Kulić , Mor Vered

Facial action units (AUs), as defined in the Facial Action Coding System (FACS), have received significant research interest owing to their diverse range of applications in facial state analysis. Current mainstream FAU recognition models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xuri Ge , Junchen Fu , Fuhai Chen , Shan An , Nicu Sebe , Joemon M. Jose

Facial Emotion Analysis (FEA) extends traditional facial emotion recognition by incorporating explainable, fine-grained reasoning. The task integrates three subtasks: emotion recognition, facial Action Unit (AU) recognition, and AU-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jiulong Wu , Yucheng Shen , Lingyong Yan , Haixin Sun , Deguo Xia , Jizhou Huang , Min Cao

Although state-of-the-art classifiers for facial expression recognition (FER) can achieve a high level of accuracy, they lack interpretability, an important feature for end-users. Experts typically associate spatial action units (AUs) from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Soufiane Belharbi , Marco Pedersoli , Alessandro Lameiras Koerich , Simon Bacon , Eric Granger

Recent advances in Multimodal Large Language Models (MLLMs) have created new opportunities for facial expression recognition (FER), moving it beyond pure label prediction toward reasoning-based affect understanding. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Shifeng Liu , Zhengye Zhang , Sirui Zhao , Xinglong Mao , Zhehan Kan , Zhixiang Wei , Shiwei Wu , Chaoyou Fu , Tong Xu , Enhong Chen

Vision--Language--Action (VLA) policies have shown strong progress in mapping language instructions and visual observations to robotic actions, yet their reliability degrades in cluttered scenes with distractors. By analyzing failure cases,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Jiaying Zhou , Zhihao Zhan , Ruifeng Zhai , Qinhan Lyu , Hao Liu , Keze Wang , Liang Lin , Guangrun Wang

Micro-expression Action Unit (AU) detection identifies localized AUs from subtle facial muscle activations, providing a foundation for decoding affective cues. Previous methods face three key limitations: (1) heavy reliance on low-density…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zhishu Liu , Kaishen Yuan , Bo Zhao , Hui Ma , Zitong Yu

Although state-of-the-art classifiers for facial expression recognition (FER) can achieve a high level of accuracy, they lack interpretability, an important feature for end-users. Experts typically associate spatial action units (\aus) from…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Soufiane Belharbi , Marco Pedersoli , Alessandro Lameiras Koerich , Simon Bacon , Eric Granger

Facial Action Units (AUs) represent a set of facial muscular activities and various combinations of AUs can represent a wide range of emotions. AU recognition is often used in many applications, including marketing, healthcare, education,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Junya Saito , Xiaoyu Mi , Akiyoshi Uchida , Sachihiro Youoku , Takahisa Yamamoto , Kentaro Murase , Osafumi Nakayama

Dynamic Facial Expression Recognition(DFER) is a rapidly evolving field of research that focuses on the recognition of time-series facial expressions. While previous research on DFER has concentrated on feature learning from a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Feng Liu , Lingna Gu , Chen Shi , Xiaolan Fu

Facial Action Coding System is an important approach of facial expression analysis.This paper describes our submission to the third Affective Behavior Analysis (ABAW) 2022 competition. We proposed a transfomer based model to detect facial…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Lingfeng Wang , Shisen Wang , Jin Qi

Face Emotion Recognition (FER) is essential for social interactions and understanding others' mental states. Utilizing eye tracking to investigate FER has yielded insights into cognitive processes. In this study, we utilized an…

Human-Computer Interaction · Computer Science 2025-03-21 Meisam J. Seikavandi , Maria J. Barrett , Paolo Burelli

This paper presents our Facial Action Units (AUs) detection submission to the fifth Affective Behavior Analysis in-the-wild Competition (ABAW). Our approach consists of three main modules: (i) a pre-trained facial representation encoder…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Zihan Wang , Siyang Song , Cheng Luo , Yuzhi Zhou , Shiling Wu , Weicheng Xie , Linlin Shen

Studies have proven that domain bias and label bias exist in different Facial Expression Recognition (FER) datasets, making it hard to improve the performance of a specific dataset by adding other datasets. For the FER bias issue, recent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Shuyi Mao , Xinpeng Li , Qingyang Wu , Xiaojiang Peng

The Facial Action Coding System (FACS) has been used by numerous studies to investigate the links between facial behavior and mental health. The laborious and costly process of FACS coding has motivated the development of machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Evangelos Sariyanidi , Lisa Yankowitz , Robert T. Schultz , John D. Herrington , Birkan Tunc , Jeffrey Cohn

High-quality annotated images are significant to deep facial expression recognition (FER) methods. However, uncertain labels, mostly existing in large-scale public datasets, often mislead the training process. In this paper, we achieve…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Yang Liu , Xingming Zhang , Janne Kauttonen , Guoying Zhao

Recognizing human emotion/expressions automatically is quite an expected ability for intelligent robotics, as it can promote better communication and cooperation with humans. Current deep-learning-based algorithms may achieve impressive…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Tao Pu , Tianshui Chen , Yuan Xie , Hefeng Wu , Liang Lin

Facial Expression Recognition (FER) is a critical task within computer vision with diverse applications across various domains. Addressing the challenge of limited FER datasets, which hampers the generalization capability of expression…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Bach Nguyen-Xuan , Thien Nguyen-Hoang , Thanh-Huy Nguyen , Nhu Tai-Do

Large language models (LLMs) enable increasingly capable tutoring-style conversational agents, yet effective tutoring requires sensitivity to learners' affective and cognitive states beyond text alone. Facial expressions provide immediate…

Human-Computer Interaction · Computer Science 2026-04-20 Shuangquan Feng , Laura Fleig , Ruisen Tu , Philip Chi , Edmund Bu , Melinda Ozel , Junhua Ma , Teng Fei , Virginia R. de Sa

Facial action unit (AU) detection is challenging due to the difficulty in capturing correlated information from subtle and dynamic AUs. Existing methods often resort to the localization of correlated regions of AUs, in which predefining…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Zhiwen Shao , Yong Zhou , Jianfei Cai , Hancheng Zhu , Rui Yao
‹ Prev 1 2 3 10 Next ›