English
Related papers

Related papers: Affective Behavior Analysis using Action Unit Rela…

200 papers

Agents must monitor their partners' affective states continuously in order to understand and engage in social interactions. However, methods for evaluating affect recognition do not account for changes in classification performance that may…

Human-Computer Interaction · Computer Science 2025-09-08 Allen Chang , Lauren Klein , Marcelo R. Rosales , Weiyang Deng , Beth A. Smith , Maja J. Matarić

Micro-expressions are brief spontaneous facial expressions that appear on a face when a person conceals an emotion, making them different to normal facial expressions in subtlety and duration. Currently, emotion classes within the CASME II…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Adrian K. Davison , Walied Merghani , Moi Hoon Yap

This paper describes the fourth Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with European Conference on Computer Vision (ECCV), 2022. The 4th ABAW Competition is a continuation of the Competitions held at…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Dimitrios Kollias

Despite the success of deep neural networks on facial action unit (AU) detection, better performance depends on a large number of training images with accurate AU annotations. However, labeling AU is time-consuming, expensive, and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Yong Li , Shiguang Shan

This paper describes our submission to the fourth Affective Behavior Analysis (ABAW) competition. We proposed a hybrid CNN-Transformer model for the Multi-Task-Learning (MTL) and Learning from Synthetic Data (LSD) task. Experimental results…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Lingfeng Wang , Haocheng Li , Chunyin Liu

The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression analysis. Many methods that perform well on automatic facial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xuri Ge , Joemon M. Jose , Songpei Xu , Xiao Liu , Hu Han

In this paper we address the problem of multi-cue affect recognition in challenging scenarios such as child-robot interaction. Towards this goal we propose a method for automatic recognition of affect that leverages body expressions…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Panagiotis P. Filntisis , Niki Efthymiou , Petros Koutras , Gerasimos Potamianos , Petros Maragos

Understanding pain-related facial behaviors is essential for digital healthcare in terms of effective monitoring, assisted diagnostics, and treatment planning, particularly for patients unable to communicate verbally. Existing data-driven…

Machine Learning · Computer Science 2025-06-18 Zhiyu Wang , Yang Liu , Hatice Gunes

Facial emotion recognition is an essential and important aspect of the field of human-machine interaction. Past research on facial emotion recognition focuses on the laboratory environment. However, it faces many challenges in real-world…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Zheng Lian , Ya Li , Jian-Hua Tao , Jian Huang , Ming-Yue Niu

The 10th Affective & Behavior Analysis in-the-Wild (ABAW) Workshop and Competition, held at CVPR 2026, continues to advance research on modelling, analysis, understanding of human affect and behavior in real-world, unconstrained…

Emotions play an essential role in human communication. Developing computer vision models for automatic recognition of emotion expression can aid in a variety of domains, including robotics, digital behavioral healthcare, and media…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yang Qian , Ali Kargarandehkordi , Onur Cezmi Mutlu , Saimourya Surabhi , Mohammadmahdi Honarmand , Dennis Paul Wall , Peter Washington

This paper is a brief introduction to our submission to the seven basic expression classification track of Affective Behavior Analysis in-the-wild Competition held in conjunction with the IEEE International Conference on Automatic Face and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Hanyu Liu , Jiabei Zeng , Shiguang Shan , Xilin Chen

We present a system for concurrent activity recognition. To extract features associated with different activities, we propose a feature-to-activity attention that maps the extracted global features to sub-features associated with individual…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Yanyi Zhang , Xinyu Li , Kaixiang Huang , Yehan Wang , Shuhong Chen , Ivan Marsic

Acquisition of labeled training samples for affective computing is usually costly and time-consuming, as affects are intrinsically subjective, subtle and uncertain, and hence multiple human assessors are needed to evaluate each affective…

Machine Learning · Computer Science 2019-03-27 Dongrui Wu , Jian Huang

In this paper, we present our contribution to ABAW facial expression challenge. We report the proposed system and the official challenge results adhering to the challenge protocol. Using end-to-end deep learning and benefiting from transfer…

Machine Learning · Computer Science 2020-11-03 Denis Dresvyanskiy , Elena Ryumina , Heysem Kaya , Maxim Markitantov , Alexey Karpov , Wolfgang Minker

Action Units (AUs) are geometrically-based atomic facial muscle movements known to produce appearance changes at specific facial locations. Motivated by this observation we propose a novel AU modelling problem that consists of jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Ioanna Ntinou , Enrique Sanchez , Adrian Bulat , Michel Valstar , Georgios Tzimiropoulos

Facial action unit (FAU) intensities are popular descriptors for the analysis of facial behavior. However, FAUs are sparsely represented when only a few are activated at a time. In this study, we explore the possibility of representing the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Minh Tran , Ellen Bradley , Michelle Matvey , Joshua Woolley , Mohammad Soleymani

As one of the most important affective signals, facial affect analysis (FAA) is essential for developing human-computer interaction systems. Early methods focus on extracting appearance and geometry features associated with human affects…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Yang Liu , Xingming Zhang , Yante Li , Jinzhao Zhou , Xin Li , Guoying Zhao

We present our contribution to the 7th ABAW challenge at ECCV 2024, by utilizing a Dual-Direction Attention Mixed Feature Network (DDAMFN) for multitask facial expression recognition, we achieve results far beyond the proposed baseline for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Josep Cabacas-Maso , Elena Ortega-Beltrán , Ismael Benito-Altamirano , Carles Ventura

The muscular activities caused the activation of certain AUs for every facial expression at the certain duration of time throughout the facial expression. This paper presents the methods to recognise facial Action Unit (AU) using facial…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 N. Hussain , H. Ujir , I. Hipiny , J-L Minoi