English
Related papers

Related papers: Customizable Avatars with Dynamic Facial Action Co…

200 papers

Facial motion capture in mixed reality headsets enables real-time avatar animation, allowing users to convey non-verbal cues during virtual interactions. However, as facial motion data constitutes a behavioral biometric, its use raises…

Cryptography and Security · Computer Science 2025-07-16 Adriano Castro , Simon Hanisch , Matin Fallahi , Thorsten Strufe

Facial expression analysis based on machine learning requires large number of well-annotated data to reflect different changes in facial motion. Publicly available datasets truly help to accelerate research in this area by providing a…

Machine Learning · Computer Science 2023-01-31 Yanfu Yan , Ke Lu , Jian Xue , Pengcheng Gao , Jiayi Lyu

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

The face reenactment is a popular facial animation method where the person's identity is taken from the source image and the facial motion from the driving image. Recent works have demonstrated high quality results by combining the facial…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Soumya Tripathy , Juho Kannala , Esa Rahtu

Employing deep learning-based approaches for fine-grained facial expression analysis, such as those involving the estimation of Action Unit (AU) intensities, is difficult due to the lack of a large-scale dataset of real faces with…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Zhilei Liu , Guoxian Song , Jianfei Cai , Tat-Jen Cham , Juyong Zhang

Embodied conversational agents (ECAs) are increasingly more realistic and capable of dynamic conversations. In online surveys, anthropomorphic agents could help address issues like careless responding and satisficing, which originate from…

Human-Computer Interaction · Computer Science 2025-08-05 Matus Krajcovic , Peter Demcak , Eduard Kuric

While 3D facial animation has made impressive progress, challenges still exist in realizing fine-grained stylized 3D facial expression manipulation due to the lack of appropriate datasets. In this paper, we introduce the AUBlendSet, a 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Hao Li , Ju Dai , Feng Zhou , Kaida Ning , Lei Li , Junjun Pan

Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the…

Machine Learning · Computer Science 2018-02-21 Zhanli Chen , Rashid Ansari , Diana J. Wilkie

Automated deception detection systems can enhance health, justice, and security in society by helping humans detect deceivers in high-stakes situations across medical and legal domains, among others. This paper presents a novel analysis of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Leena Mathur , Maja J Matarić

The muscular activities caused the activation of certain AUs for every facial expression at the certain duration of time throughout the facial expression. This paper presents the methods to recognise facial Action Unit (AU) using facial…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 N. Hussain , H. Ujir , I. Hipiny , J-L Minoi

Facial action unit (AU) detection is challenging due to the difficulty in capturing correlated information from subtle and dynamic AUs. Existing methods often resort to the localization of correlated regions of AUs, in which predefining…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Zhiwen Shao , Yong Zhou , Jianfei Cai , Hancheng Zhu , Rui Yao

Most state-of-the-art approaches for Facial Action Unit (AU) detection rely upon evaluating facial expressions from static frames, encoding a snapshot of heightened facial activity. In real-world interactions, however, facial expressions…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nikhil Churamani , Sinan Kalkan , Hatice Gunes

Facial behavior constitutes the primary medium of human nonverbal communication. Existing synthesis methods predominantly follow two paradigms: coarse emotion category labels or one-hot Action Unit (AU) vectors from the Facial Action Coding…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiahe Wang , Cong Liang , Xuandong Huang , Yuxin Wang , Xin Yun , Yi Wu , Yanan Chang , Shangfei Wang

Some of the most severe bottlenecks preventing widespread development of machine learning models for human behavior include a dearth of labeled training data and difficulty of acquiring high quality labels. Active learning is a paradigm for…

Understanding human affect from facial behavior requires not only accurate recognition but also structured reasoning over the latent dependencies that drive muscle activations and their expressive outcomes. Although Action Units (AUs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Guanyu Hu , Tangzheng Lian , Dimitrios Kollias , Oya Celiktutan , Xinyu Yang

The limited nonverbal cues and spatially distributed nature of remote communication make it challenging for unacquainted members to be expressive during social interactions over video conferencing. Though it enables seeing others' facial…

Human-Computer Interaction · Computer Science 2024-04-12 Mark Armstrong , Chi-Lan Yang , Kinga Skiers , Mengzhen Lim , Tamil Selvan Gunasekaran , Ziyue Wang , Takuji Narumi , Kouta Minamizawa , Yun Suen Pai

Deep learning vision models excel with abundant supervision, but many applications face label scarcity and class imbalance. Controllable image editing can augment scarce labeled data, yet edits often introduce artifacts and entangle…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Joris Kirchner , Amogh Gudi , Marian Bittner , Chirag Raman

Facial action unit (AU) intensity is an index to describe all visually discernible facial movements. Most existing methods learn intensity estimator with limited AU data, while they lack generalization ability out of the dataset. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Xinhui Song , Tianyang Shi , Zunlei Feng , Mingli Song , Jackie Lin , Chuanjie Lin , Changjie Fan , Yi Yuan

Student engagement is a key construct for learning and teaching. While most of the literature explored the student engagement analysis on computer-based settings, this paper extends that focus to classroom instruction. To best examine…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Ömer Sümer , Patricia Goldberg , Sidney D'Mello , Peter Gerjets , Ulrich Trautwein , Enkelejda Kasneci

Facial action unit (AU) intensity plays a pivotal role in quantifying fine-grained expression behaviors, which is an effective condition for facial expression manipulation. However, publicly available datasets containing intensity…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Shiwei Jin , Zhen Wang , Lei Wang , Peng Liu , Ning Bi , Truong Nguyen