English
Related papers

Related papers: Micro-expression Action Unit Detection with Spatio…

200 papers

Facial action units (AUs) play an indispensable role in human emotion analysis. We observe that although AU-based high-level emotion analysis is urgently needed by real-world applications, frame-level AU results provided by previous works…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yingjie Chen , Jiarui Zhang , Tao Wang , Yun Liang

Facial pain expression is an important modality for assessing pain, especially when the patient's verbal ability to communicate is impaired. The facial muscle-based action units (AUs), which are defined by the Facial Action Coding System…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Zhanli Chen , Rashid Ansari , Diana Wilkie

As a spontaneous expression of emotion on face, micro-expression reveals the underlying emotion that cannot be controlled by human. In micro-expression, facial movement is transient and sparsely localized through time. However, the existing…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Min Peng , Chongyang Wang , Yuan Gao , Tao Bi , Tong Chen , Yu Shi , Xiang-Dong Zhou

Pain is a common occurrence among patients admitted to Intensive Care Units. Pain assessment in ICU patients still remains a challenge for clinicians and ICU staff, specifically in cases of non-verbal sedated, mechanically ventilated, and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Subhash Nerella , Kia Khezeli , Andrea Davidson , Patrick Tighe , Azra Bihorac , Parisa Rashidi

Facial Expression Recognition (FER) in the wild is an extremely challenging task. Recently, some Vision Transformers (ViT) have been explored for FER, but most of them perform inferiorly compared to Convolutional Neural Networks (CNN). This…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Fanglei Xue , Qiangchang Wang , Zichang Tan , Zhongsong Ma , Guodong Guo

Most of the current action recognition algorithms are based on deep networks which stack multiple convolutional, pooling and fully connected layers. While convolutional and fully connected operations have been widely studied in the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Ahmed Mazari , Hichem Sahbi

Micro-actions are subtle, localized movements lasting 1-3 seconds such as scratching one's head or tapping fingers. Such subtle actions are essential for social communication, ubiquitously used in natural interactions, and thus critical for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Naga VS Raviteja Chappa , Evangelos Sariyanidi , Lisa Yankowitz , Gokul Nair , Casey J. Zampella , Robert T. Schultz , Birkan Tunç

The muscular activities caused the activation of certain AUs for every facial expression at the certain duration of time throughout the facial expression. This paper presents the methods to recognise facial Action Unit (AU) using facial…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 N. Hussain , H. Ujir , I. Hipiny , J-L Minoi

Micro-expressions (MEs) are regarded as important indicators of an individual's intrinsic emotions, preferences, and tendencies. ME analysis requires spotting of ME intervals within long video sequences and recognition of their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zizheng Guo , Bochao Zou , Junbao Zhuo , Huimin Ma

This paper proposes a supervised learning approach to jointly perform facial Action Unit (AU) localisation and intensity estimation. Contrary to previous works that try to learn an unsupervised representation of the Action Unit regions, we…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Enrique Sanchez-Lozano , Georgios Tzimiropoulos , Michel Valstar

Recent studies have focused on utilizing multi-modal data to develop robust models for facial Action Unit (AU) detection. However, the heterogeneity of multi-modal data poses challenges in learning effective representations. One such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Xiang Zhang , Huiyuan Yang , Taoyue Wang , Xiaotian Li , Lijun Yin

The Facial Action Coding System (FACS) for studying facial expressions is manual and requires significant effort and expertise. This paper explores the use of automated techniques to generate Action Units (AUs) for studying facial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Shivansh Chandra Tripathi , Rahul Garg

Active Appearance Model (AAM) is a commonly used method for facial image analysis with applications in face identification and facial expression recognition. This paper proposes a new approach based on image alignment for AAM fitting called…

Computer Vision and Pattern Recognition · Computer Science 2015-11-23 Ali Mollahosseini , Mohammad H. Mahoor

Leveraging the synergy of both audio data and visual data is essential for understanding human emotions and behaviors, especially in in-the-wild setting. Traditional methods for integrating such multimodal information often stumble, leading…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jun Yu , Zerui Zhang , Zhihong Wei , Gongpeng Zhao , Zhongpeng Cai , Yongqi Wang , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Recent object detection approaches rely on pretrained vision-language models for image-text alignment. However, they fail to detect the Mobile User Interface (MUI) element since it contains additional OCR information, which describes its…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Zhangxuan Gu , Zhuoer Xu , Haoxing Chen , Jun Lan , Changhua Meng , Weiqiang Wang

Facial expressions are one of the most effective ways for non-verbal communications, which can be expressed as the Micro-Expression (ME) in the high-stake situations. The MEs are involuntary, rapid, and, subtle, and they can reveal real…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Vida Esmaeili , Mahmood Mohassel Feghhi , Seyed Omid Shahdi

Facial behavior constitutes the primary medium of human nonverbal communication. Existing synthesis methods predominantly follow two paradigms: coarse emotion category labels or one-hot Action Unit (AU) vectors from the Facial Action Coding…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiahe Wang , Cong Liang , Xuandong Huang , Yuxin Wang , Xin Yun , Yi Wu , Yanan Chang , Shangfei Wang

Temporal modelling is the key for efficient video action recognition. While understanding temporal information can improve recognition accuracy for dynamic actions, removing temporal redundancy and reusing past features can significantly…

Computer Vision and Pattern Recognition · Computer Science 2021-02-12 Yue Meng , Rameswar Panda , Chung-Ching Lin , Prasanna Sattigeri , Leonid Karlinsky , Kate Saenko , Aude Oliva , Rogerio Feris

Micro-expression recognition is one of the most challenging topics in affective computing. It aims to recognize tiny facial movements difficult for humans to perceive in a brief period, i.e., 0.25 to 0.5 seconds. Recent advances in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Xuan-Bac Nguyen , Chi Nhan Duong , Xin Li , Susan Gauch , Han-Seok Seo , Khoa Luu

The intensity estimation of facial action units (AUs) is challenging due to subtle changes in the person's facial appearance. Previous approaches mainly rely on probabilistic models or predefined rules for modeling co-occurrence…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Yingruo Fan , Jacqueline C. K. Lam , Victor O. K. Li