English
Related papers

Related papers: Facial Affective Behavior Analysis Method for 5th …

200 papers

Analysis of human affect plays a vital role in human-computer interaction (HCI) systems. Due to the difficulty in capturing large amounts of real-life data, most of the current methods have mainly focused on controlled environments, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jun Yu , Zhongpeng Cai , Peng He , Guocheng Xie , Qiang Ling

Facial affective behavior analysis (FABA) is crucial for understanding human mental states from images. However, traditional approaches primarily deploy models to discriminate among discrete emotion categories, and lack the fine granularity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Yifan Li , Anh Dao , Wentao Bao , Zhen Tan , Tianlong Chen , Huan Liu , Yu Kong

As one of the most important affective signals, facial affect analysis (FAA) is essential for developing human-computer interaction systems. Early methods focus on extracting appearance and geometry features associated with human affects…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Yang Liu , Xingming Zhang , Yante Li , Jinzhao Zhou , Xin Li , Guoying Zhao

Deep models for facial expression recognition achieve high performance by training on large-scale labeled data. However, publicly available datasets contain uncertain facial expressions caused by ambiguous annotations or confusing emotions,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Yang Liu , Xingming Zhang , Janne Kauttonen , Guoying Zhao

In our multicultural world, affect-aware AI systems that support humans need the ability to perceive affect across variations in emotion expression patterns across cultures. These systems must perform well in cultural contexts without…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Leena Mathur , Ralph Adolphs , Maja J Matarić

Recognizing facial expression in a wild setting has remained a challenging task in computer vision. The World Wide Web is a good source of facial images which most of them are captured in uncontrolled conditions. In fact, the Internet is a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Ali Mollahosseini , Behzad Hassani , Michelle J. Salvador , Hojjat Abdollahi , David Chan , Mohammad H. Mahoor

Some of the most severe bottlenecks preventing widespread development of machine learning models for human behavior include a dearth of labeled training data and difficulty of acquiring high quality labels. Active learning is a paradigm for…

Human emotions analysis has been the focus of many studies, especially in the field of Affective Computing, and is important for many applications, e.g. human-computer intelligent interaction, stress analysis, interactive games, animations,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Mohammad Rami Koujan , Luma Alharbawee , Giorgos Giannakakis , Nicolas Pugeault , Anastasios Roussos

This paper presents our method for the estimation of valence-arousal (VA) in the 8th Affective Behavior Analysis in-the-Wild (ABAW) competition. Our approach integrates visual and audio information through a multimodal framework. The visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jun Yu , Yongqi Wang , Lei Wang , Yang Zheng , Shengfan Xu

Video content is rich in semantics and has the ability to evoke various emotions in viewers. In recent years, with the rapid development of affective computing and the explosive growth of visual data, affective video content analysis (AVCA)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Junxiao Xue , Jie Wang , Xuecheng Wu , Qian Zhang

The development of agents with emotional intelligence is becoming increasingly vital due to their significant role in human-computer interaction and the growing integration of computer systems across various sectors of society. Affective…

Human-Computer Interaction · Computer Science 2026-05-05 Raziyeh Zall , Alireza Kheyrkhah , Erik Cambria , Zahra Naseri , M. Reza Kangavari

This paper introduces our approach to the EmotioNet Challenge 2020. We pose the AU recognition problem as a multi-task learning problem, where the non-rigid facial muscle motion (mainly the first 17 AUs) and the rigid head motion (the last…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Pengcheng Wang , Zihao Wang , Zhilong Ji , Xiao Liu , Songfan Yang , Zhongqin Wu

The quantified measurement of facial expressiveness is crucial to analyze human affective behavior at scale. Unfortunately, methods for expressiveness quantification at the video frame-level are largely unexplored, unlike the study of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Md Taufeeq Uddin , Shaun Canavan

This paper presents the results of the SUN team for the Compound Expressions Recognition Challenge of the 6th ABAW Competition. We propose a novel audio-visual method for compound expression recognition. Our method relies on emotion…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Elena Ryumina , Maxim Markitantov , Dmitry Ryumin , Heysem Kaya , Alexey Karpov

Rapid development of artificial intelligence (AI) systems amplify many concerns in society. These AI algorithms inherit different biases from humans due to mysterious operational flow and because of that it is becoming adverse in usage. As…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Artem Domnich , Gholamreza Anbarjafari

Facial Emotion Analysis (FEA) extends traditional facial emotion recognition by incorporating explainable, fine-grained reasoning. The task integrates three subtasks: emotion recognition, facial Action Unit (AU) recognition, and AU-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jiulong Wu , Yucheng Shen , Lingyong Yan , Haixin Sun , Deguo Xia , Jizhou Huang , Min Cao

Recent advances in deep learning (DL) and computational capacity have enabled facial affective behavior analysis (FABA) to progress from static images captured in controlled settings to fine-grained analysis of facial expressions in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 R. Gnana Praveen , Patrick Cardinal , Eric Granger

Unlike the six basic emotions of happiness, sadness, fear, anger, disgust and surprise, modelling and predicting dimensional affect in terms of valence (positivity - negativity) and arousal (intensity) has proven to be more flexible,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Chaudhary Muhammad Aqdus Ilyas , Siyang Song , Hatice Gunes

This paper describes an approach to the facial action units detections. The involved action units (AU) include AU1 (Inner Brow Raiser), AU2 (Outer Brow Raiser), AU4 (Brow Lowerer), AU6 (Cheek Raise), AU12 (Lip Corner Puller), AU15 (Lip…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Xianpeng Ji , Yu Ding , Lincheng Li , Yu Chen , Changjie Fan

Understanding the facial expressions of our interlocutor is important to enrich the communication and to give it a depth that goes beyond the explicitly expressed. In fact, studying one's facial expression gives insight into their hidden…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Rim EL Cheikh , Hélène Tran , Issam Falih , Engelbert Mephu Nguifo