English
Related papers

Related papers: Analysing Affective Behavior in the second ABAW2 C…

200 papers

Facial action unit recognition is an important task for facial analysis. Owing to the complex collection environment, facial action unit recognition in the wild is still challenging. The 3rd competition on affective behavior analysis…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shangfei Wang , Yanan Chang , Jiahe Wang

Facial Expression Recognition (FER) plays a crucial role in computer vision and finds extensive applications across various fields. This paper aims to present our approach for the upcoming 6th Affective Behavior Analysis in-the-Wild (ABAW)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Jun Yu , Zhihong Wei , Zhongpeng Cai , Gongpeng Zhao , Zerui Zhang , Yongqi Wang , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Analysis of human affect plays a vital role in human-computer interaction (HCI) systems. Due to the difficulty in capturing large amounts of real-life data, most of the current methods have mainly focused on controlled environments, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jun Yu , Zhongpeng Cai , Peng He , Guocheng Xie , Qiang Ling

This paper addresses the expression (EXPR) recognition challenge in the 10th Affective Behavior Analysis in-the-Wild (ABAW) workshop and competition, which requires frame-level classification of eight facial emotional expressions from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiajun Sun , Zhe Gao

This paper presents our method for the estimation of valence-arousal (VA) in the 8th Affective Behavior Analysis in-the-Wild (ABAW) competition. Our approach integrates visual and audio information through a multimodal framework. The visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jun Yu , Yongqi Wang , Lei Wang , Yang Zheng , Shengfan Xu

Emotional Mimicry Intensity (EMI) estimation plays a pivotal role in understanding human social behavior and advancing human-computer interaction. The core challenges lie in dynamic correlation modeling and robust fusion of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jun Yu , Lingsi Zhu , Yanjun Chi , Yunxiang Zhang , Yang Zheng , Yongqi Wang , Xilong Lu

In the context of HCI, building an automatic system to recognize affect of human facial expression in real-world condition is very crucial to make machine interact naturallisticaly with a man. However, existing facial emotion databases…

Machine Learning · Computer Science 2019-12-17 Mengyao Liu , Dimitrios Kollias

Human affective behavior analysis aims to delve into human expressions and behaviors to deepen our understanding of human emotions. Basic expression categories (EXPR) and Action Units (AUs) are two essential components in this analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Li Lin , Sarah Papabathini , Xin Wang , Shu Hu

In this paper we introduce AFFDEX 2.0 - a toolkit for analyzing facial expressions in the wild, that is, it is intended for users aiming to; a) estimate the 3D head pose, b) detect facial Action Units (AUs), c) recognize basic emotions and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Mina Bishay , Kenneth Preston , Matthew Strafuss , Graham Page , Jay Turcot , Mohammad Mavadati

This report provides a brief description of our proposed solution for the Vocal Burst Type classification task of the ACII 2022 Affective Vocal Bursts (A-VB) Competition. We experimented with two approaches as part of our solution for the…

Sound · Computer Science 2022-10-14 Muhammad Shehram Shah Syed , Zafi Sherhan Syed , Abbas Syed

Some of the most severe bottlenecks preventing widespread development of machine learning models for human behavior include a dearth of labeled training data and difficulty of acquiring high quality labels. Active learning is a paradigm for…

Face based affective computing consists in detecting emotions from face images. It is useful to unlock better automatic comprehension of human behaviours and could pave the way toward improved human-machines interactions. However it comes…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Gauthier Tallec , Jules Bonnard , Arnaud Dapogny , Kévin Bailly

In this paper, we introduce Behavior4All, a comprehensive, open-source toolkit for in-the-wild facial behavior analysis, integrating Face Localization, Valence-Arousal Estimation, Basic Expression Recognition and Action Unit Detection, all…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Dimitrios Kollias , Chunchang Shao , Odysseus Kaloidas , Ioannis Patras

This paper describes our submission to the fourth Affective Behavior Analysis (ABAW) competition. We proposed a hybrid CNN-Transformer model for the Multi-Task-Learning (MTL) and Learning from Synthetic Data (LSD) task. Experimental results…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Lingfeng Wang , Haocheng Li , Chunyin Liu

We present our contribution to the 7th ABAW challenge at ECCV 2024, by utilizing a Dual-Direction Attention Mixed Feature Network (DDAMFN) for multitask facial expression recognition, we achieve results far beyond the proposed baseline for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Josep Cabacas-Maso , Elena Ortega-Beltrán , Ismael Benito-Altamirano , Carles Ventura

Understanding and predicting human behavior has emerged as a core capability in various AI application domains such as autonomous driving, smart healthcare, surveillance systems, and social robotics. This paper defines the technical…

Artificial Intelligence · Computer Science 2025-05-07 Kanghyun Jo , Jehwan Choi , Kwanho Kim , Seongmin Kim , Duy-Linh Nguyen , Xuan-Thuy Vo , Adri Priadana , Tien-Dat Tran

In recent decades, the field of affective computing has made substantial progress in advancing the ability of AI systems to recognize and express affective phenomena, such as affect and emotions, during human-human and human-machine…

Human-Computer Interaction · Computer Science 2023-05-19 Leena Mathur , Maja J Matarić , Louis-Philippe Morency

In our multicultural world, affect-aware AI systems that support humans need the ability to perceive affect across variations in emotion expression patterns across cultures. These systems must perform well in cultural contexts without…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Leena Mathur , Ralph Adolphs , Maja J Matarić

The paper describes our proposed methodology for the six basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2022. In Learing from Synthetic Data(LSD) task, facial expression recognition (FER)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Shuyi Mao , Xinpeng Li , Junyao Chen , Xiaojiang Peng

To describe complex emotional states, psychologists have proposed multiple emotion descriptors: sparse descriptors like facial action units; continuous descriptors like valence and arousal; and discrete class descriptors like happiness and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Didan Deng