English
Related papers

Related papers: Facial Action Unit Detection on ICU Data for Pain …

200 papers

Agents must monitor their partners' affective states continuously in order to understand and engage in social interactions. However, methods for evaluating affect recognition do not account for changes in classification performance that may…

Human-Computer Interaction · Computer Science 2025-09-08 Allen Chang , Lauren Klein , Marcelo R. Rosales , Weiyang Deng , Beth A. Smith , Maja J. Matarić

Since Facial Action Unit (AU) annotations require domain expertise, common AU datasets only contain a limited number of subjects. As a result, a crucial challenge for AU detection is addressing identity overfitting. We find that AUs and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Zhipeng Hu , Wei Zhang , Lincheng Li , Yu Ding , Wei Chen , Zhigang Deng , Xin Yu

Assessing chronic pain behavior in mice is critical for preclinical studies. However, existing methods mostly rely on manual labeling of behavioral features, and humans lack a clear understanding of which behaviors best represent chronic…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Yu-Hsi Chen , Wei-Hsin Chen , Chien-Yao Wang , Hong-Yuan Mark Liao , James C. Liao , Chien-Chang Chen

Assessing learner competency in clinical simulation requires expert observation that is time-intensive, difficult to scale, and subject to inter-rater variability. Vision-language models have emerged as a promising tool for understanding…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hanchen David Wang , Yilin Liu , Madison J. Lee , Surya Chand Rayala , Gautam Biswas , Daniel T. Levin , Meiyi Ma

The detection of facial action units (AUs) has been studied as it has the competition due to the wide-ranging applications thereof. In this paper, we propose a novel framework for the AU detection from a single input image by grasping the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Ziqiang Shi , Liu Liu , Zhongling Liu , Rujie Liu , Xiaoyu Mi , and Kentaro Murase

Human facial action units (AUs) are mutually related in a hierarchical manner, as not only they are associated with each other in both spatial and temporal domains but also AUs located in the same/close facial regions show stronger…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zihan Wang , Siyang Song , Cheng Luo , Songhe Deng , Weicheng Xie , Linlin Shen

With the development of the Internet of Things(IoT) and Artificial Intelligence(AI) technologies, human activity recognition has enabled various applications, such as smart homes and assisted living. In this paper, we target a new…

Machine Learning · Computer Science 2021-06-30 Rex Liu , Sarina A Fazio , Huanle Zhang , Albara Ah Ramli , Xin Liu , Jason Yeates Adams

This paper addresses the task of assessing PICU team's leadership skills by developing an automated analysis framework based on egocentric vision. We identify key behavioral cues, including fixation object, eye contact, and conversation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Liangyang Ouyang , Yuki Sakai , Ryosuke Furuta , Hisataka Nozawa , Hikoro Matsui , Yoichi Sato

Recognizing human emotion/expressions automatically is quite an expected ability for intelligent robotics, as it can promote better communication and cooperation with humans. Current deep-learning-based algorithms may achieve impressive…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Tao Pu , Tianshui Chen , Yuan Xie , Hefeng Wu , Liang Lin

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

Facial micro-expressions are spontaneous, brief and subtle facial motions that unveil the underlying, suppressed emotions. Detecting Action Units (AUs) in micro-expressions is crucial because it yields a finer representation of facial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Huai-Qian Khor , Yante Li , Xingxun Jiang , Guoying Zhao

High-quality annotated images are significant to deep facial expression recognition (FER) methods. However, uncertain labels, mostly existing in large-scale public datasets, often mislead the training process. In this paper, we achieve…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Yang Liu , Xingming Zhang , Janne Kauttonen , Guoying Zhao

Generative models have surged in popularity recently due to their ability to produce high-quality images and video. However, steering these models to produce images with specific attributes and precise control remains challenging. Humans,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Tuomas Varanka , Huai-Qian Khor , Yante Li , Mengting Wei , Hanwei Kung , Nicu Sebe , Guoying Zhao

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi

Purpose: As visual inspection is an inherent process during radiological screening, the associated eye gaze data can provide valuable insights into relevant clinical decisions. As deep learning has become the state-of-the-art for…

Image and Video Processing · Electrical Eng. & Systems 2025-02-18 Zirui Qiu , Hassan Rivaz , Yiming Xiao

Human affective behavior analysis plays a vital role in human-computer interaction (HCI) systems. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). We propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun Yu , Renda Li , Zhongpeng Cai , Gongpeng Zhao , Guochen Xie , Jichao Zhu , Wangyuan Zhu

As machine learning approaches are increasingly used to augment human decision-making, eXplainable Artificial Intelligence (XAI) research has explored methods for communicating system behavior to humans. However, these approaches often fail…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Luke Guerdan , Alex Raymond , Hatice Gunes

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

We consider the task of automated estimation of facial expression intensity. This involves estimation of multiple output variables (facial action units --- AUs) that are structurally dependent. Their structure arises from statistically…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Robert Walecki , Ognjen , Rudovic , Vladimir Pavlovic , Björn Schuller , Maja Pantic

Attention mechanism has recently attracted increasing attentions in the field of facial action unit (AU) detection. By finding the region of interest of each AU with the attention mechanism, AU-related local features can be captured. Most…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Zhiwen Shao , Zhilei Liu , Jianfei Cai , Yunsheng Wu , Lizhuang Ma